Health Program Evaluation: Scoping the Evaluation

Program planners, designers and implementers are often faced with the task of having to develop an evaluation plan or framework for the program/project that they are working on. This requires scoping the boundary of the evaluation and choosing the most appropriate evaluation questions and approach. Planning, negotiation, program logic modelling and evaluation criteria/indicator selection are integral components of this task. It is in these areas that this course is concentrated. Other areas covered include evaluation purpose, types, and questions; evaluation utilization; choosing outcomes for measurement; and key steps for planning and negotiating the evaluation.

This course is designed for those involved in developing evaluation plans/frameworks for public health or health service related programs or projects. Participants do not require any background training or knowledge of evaluation, however, experience or knowledge of health programs, policies or services would be an advantage.

Key concepts and approaches underpinning the course activities can be applied immediately to workplace programs.  The third day is practical based, and involves working in groups on work-based programs – your own, or that of others.

This short course will be delivered via Zoom. Tailored courses can be delivered for workplaces anywhere in Australia for groups of 10 or more. This could be a more cost-effective option for larger groups. Please contact us for more information.

The course is delivered online over 3.5 days:

Day 1:
Course participants explore the definition of evaluation, and discuss the purpose and process of ‘valuing’ a health program, service or initiative. The different forms of evaluation are presented and discussed in relation to course participants’ own experiences in evaluation. Program logic is introduced, and participants are provided with examples of logic diagrams that extend beyond the typical minimal ‘template’ model, demonstrating the different levels of use of logic diagrams, particularly from a systems perspective. The relevance of program logic diagrams to evaluation and consequently program planning, design, and re-design is illustrated through demonstration and group activity.

Day 2:
Course participants explore the importance of evaluation utilisation and what strategies can be undertaken to promote the use of evaluations during evaluation planning, implementation and reporting (e.g. stakeholder negotiation and consultation). Participants explore evaluation questions with a particular focus on the range of process and outcome associated questions. Participants are given the opportunity to consider the range of issues concerning the selection of outcomes and their associated indicators for measurement. Activities throughout the day provide participants with hands-on experience and opportunities to apply the key concepts and lessons to a range of health programs or service arrangements.

Day 3:
Students self-select a project to work on in groups or on their own. Participants can bring projects from their workplace, though this is not necessary. Groups develop a program logic and work towards developing an evaluation plan for the selected program/service over the course of the day with assistance from Helen Jordan. Participants then explore through discussion ways in which they can build or utilize existing resources and structures to practise and further develop the evaluation planning and implementation skills developed throughout the course.

Day 4 (half day):
During this half day session, groups will showcase the product of their work developed in Day 3. We will then end with a summary of the key steps and considerations required to develop an evaluation plan and discuss the ‘what next’ to progress the planning post course.