Estimating market size like Fermi
Enrico Fermi (1901-1954) was an eminent physicist who developed a knack for intuitive, even casual sounding measurements. The value of quick estimates was something Fermi was familiar with. He was well known for teaching his students skills to approximate fanciful-sounding quantities that, at first glance, they might presume they knew nothing about. The best […]
Read moreThe long and short of measurement
The concept of measurement can be daunting. As a research and evaluation consultant I am often asked whether my approach will be ‘statistically significant’ or how reliable the outcomes will be. Here are a few basic elements of evaluation and measurement which should hopefully address some of these questions. The concept of measurement The […]
Read moreThe Rule of Five. A quick and easy way to reduce uncertainty in business
Suppose you have a business dilemma or decision to make that seems insurmountable. The problem is complex and you don’t know where to start to begin to understand what to do. Douglas Hubbard, an internationally recognised expert in metrics, decision analysis and risk management, devised a simple example of a quick measurement anyone can do […]
Read moreThe reliability of qualitative research
Reliability is a concept that refers to producing consistent results time after time. If you commission a qualitative research or evaluation project, how can you be sure it is reliable? Don’t you need statistics to make research reliable? No. Because, although the term ‘reliability’ is usually applied as a concept for testing or evaluating quantitative […]
Read moreYou’re being watched. Observation methods in social research and evaluation
Observation is a systematic process of recording the behavioural patterns of people, objects and occurrences without questioning or otherwise communicating with them. It’s a bit like professional stalking, but with ethical and design limitations. The technique can be used as a tool for scientific enquiry when it serves a specific research purpose, is planned and […]
Read moreUnwillingness to answer. 4 reasons why people refuse to respond
If you’ve ever used a survey in a research or evaluation project, you may have encountered unanswered questions by some respondents. Even if respondents are able to answer a particular question, they may be unwilling to do so. There are usually four key reasons why respondents sometimes don’t answer questions in surveys. 1. It’s too […]
Read more3 tips for good data collection
Collecting high quality data is essential to the success of any project or initiative. Funding providers and, especially, local project managers, often play important roles in data collection. There are several things that need to be considered to ensure that data collection processes and measurement systems are stable and reliable. Incorporating these into a data […]
Read more2015- International Year of Evaluation
Did you know that 2015 has been declared the International Year of Evaluation? Fondly known as EvalYear, this came about following endorsement at a series of evaluation conferences in 2013 and 2014 and the UN’s adoption of a resolution which asks member countries to strengthen their evaluation capacity and, in 2016, report on their progress. […]
Read moreHow soon can I have results?
Every year it seems the Christmas season arrives earlier than the year before. Marketing and retail displays seem to be up sooner each year and I swear Christmas carols have been playing in department stores since about July. This retail marketing strategy, coupled with our constant connection to our smart phones means our ability to […]
Read more8 tips for commissioning an evaluation
If you are considering commissioning and conducting an evaluation, all parties should be fully informed about what is expected to be delivered and what can be reasonably expected to be delivered. The Australasian Evaluation Society has prepared a helpful guide, which is applicable to an evaluation in any sector, including arts, cultural, environmental, regional, business […]
Read more