Apr 15 2016

Theory-based evaluation – addressing an evaluation deficit

Evaluations conducted in the field of arts and cultural initiatives in Australia are often critiqued for their methodologically weakness. Concerns amongst peers and academics have included their reliance on small sample sizes, anecdotal evidence, limited hypothesis testing and little attention to the examination of internal program mechanisms with the aim of looking for causal factors […]

Read more
Mar 29 2016

Monitoring is not evaluation

Monitoring and evaluation are often used interchangeably, yet they are different concepts. As a result, evaluation may be being compromised. Here is the difference between the two terms and their different purposes. Monitoring Monitoring is an ongoing activity of systematic and routine collection of information. Monitoring checks on the progress of a program or initiative […]

Read more
Mar 21 2016

Quantitative research in evaluation – for what purpose?

Evaluation is a field in which evaluators are looking for mechanisms within program that bring about effects. The practice of evaluation involves making a judgement and also often testing a hypothesis of explanation of a theory. In order to make a sound judgement or test a theory, the evaluator needs to gather evidence, either in […]

Read more
Feb 17 2016

Rockhampton Retrospective – 3 years, 8 key challenges

Creative Capricorn was a three-year cultural program rolled out in Rockhampton, Queensland. Its aim was to demonstrate that when integrated into economics, social and community planning, arts and cultural projects can assist in the diversification of local economies, increase social cohesion and improve quality of life for the community. NSF was commissioned to evaluate this […]

Read more
Feb 9 2016

Low carbohydrate? Or poor performance indicators?

I recently purchased a loaf of ‘low carbohydrate’ bread (see image). Now, looking at this loaf, I think you will agree there is no denying that this loaf would be lower in carbohydrates than other loaves. But that is possibly because it has a great big hole in it. I’m only kidding, of course, but […]

Read more
Feb 1 2016

How do you decide who to recruit for your research?

Typically, evaluation and research is about human beings. Our focus of interest is often users of programs or initiatives. They may be individuals, social groups, special interest groups, clubs, companies, cities or countries. We need to identify people willing to provide their experiences, thoughts, ratings, assessments, or other input into the topic of interest. But […]

Read more
Jan 21 2016

Numbers or words? The qualitative vs quantitative debate

Over the past 20 years or so, a debate over the relative virtues of quantitative and qualitative methodology has gained considerable momentum. In the field of social research and evaluation, quantitative research has been considered as the more ‘traditional’ approach to addressing a research question. Decades ago, researchers advocating for the use of qualitative methods […]

Read more
Nov 28 2015

How significant is that?

When you look at survey results do you ask yourself ‘Are there numbers statistically significant? Yes or no?’ ‘Significance’ is a commonly used word in statistics. Significance tests suggest confidence in survey findings; that the findings matter and are meaningful.  But perhaps a term like ‘meaningful’ may be a more helpful way to assess statistics […]

Read more
Nov 16 2015

Ice creams cause drownings. And other causal relationship myths

      Ice creams cause drownings. And there are numbers to prove it.  If you take the number of ice creams sold and compare it to the number of drownings there is clearly an upward trend. And it is therefore safe to conclude from this that we should ban ice cream because ice cream […]

Read more
Nov 6 2015

How good is good?

The practice of evaluation involves arriving at succinct answers to important questions. This is also known as evaluative reasoning. Evaluative reasoning is what distinguishes from research. Evaluations involve  conducting research, but they go further, to determine merit of worth, with the aim of making evaluative conclusions. To evaluate is to make deductive arguments and claims […]

Read more