Yes, please be judgemental
Evaluation is a field in which we encourage judgement. Rather than living by the ‘Please don’t be so judgemental’ mantra, evaluation is about judgement. It involves pulling all of the empirical data together and making a call. Making a judgement in evaluation goes from the ‘what is so’ (typical of research), to the ‘so what’. […]
Read moreWhen to make an impact
You’ve delivered a government program or initiative with specific objectives in mind and now you ask yourself: “What was the impact of this program? How can an evaluation answer this question?” You’re right in leaning towards evaluation to answer your question about impact. But is this the right time? Have you let enough time pass […]
Read moreCollaborating with regional communities
It’s well understood now that arts and culture make regional Australia a better place. Communities thrive when people come together to share stories, reflect on a common history, and build social inclusion through arts and cultural activity. Last year NSF Consulting was commissioned by Regional Arts Australia to research and prepare a guidelines document to […]
Read moreEvaluating transformation
I’m currently ensconced in report writing for an evaluation project. That is not an uncommon situation to be in, as I work as a program evaluator and consultant. But this project is different; it is more challenging than many, as it poses some big theoretical questions. I am evaluating Small Town Transformations; an initiative of […]
Read moreLessons from the regions
Having recently returned from a 10 day road trip around regional Victoria I am reflecting on the lessons that can be learned when consulting with communities in small towns. This is because the turn-out to my scheduled consultation meetings was lower than I had hoped. My road trip was a mid-point reading on the mood […]
Read moreEvaluation or research?
Sometimes research and evaluation can be confused or conflated. When commissioning a project it is important to be clear about whether you require research or evaluation. Because, despite them being related and sharing some common approaches, they are different disciplines that result in considerably different outcomes. I have identified five ways in which research and […]
Read moreKPIs: Key Performance Indicators? Or perhaps not so key?
KPIs: Key Performance Indicators. Surely they’re the most relevant indicator when conducting an evaluation, right? KPIs are widely known and used in the business world. They are known as measurement values that demonstrate how effectively a company is achieving its key business objectives. KPIs are typically quantifiable measures that are used to track and assess […]
Read moreCause and effect: why does it matter?
Causation can be a basic concept in everyday life. If you slip on a banana peel you will likely fall, therefore it makes logical sense to say that the presence of a banana peel in your path caused you to fall. But things can also get more complex than that. If you think about what […]
Read moreEvaluation in the regional arts sector – current thinking
In the last decade or so, regional arts programs have been designed to be powerful tools with which to engage communities in various levels of change. They have been delivered to address regional renewal, health outcomes, quality of life, sense of place, transformation, social development and marginalisation. Yet, the literature reveals deficiencies in the quality […]
Read moreCommunity Panels: consistent consultation in small regional towns
Consulting with communities over the long-term in small regional towns in Australia presents similar challenges to consultation in cities. How do you target the right people for consultation? How do you keep people engaged for long-term projects? It is a myth that small towns folk have more time on their hands than their busy city […]
Read more