In this section

• Step 1: Objectives
• Step 2: Formative or Summative Evaluation
• Step 3: Evaluation Questions
• Step 4: Outputs and Outcomes

---

Step 1: Objectives

The first step is to review the objectives or goals of your public engagement project and remind yourself of the aims. If the objectives have not yet been set and the project is already underway, you can articulate these now: aim for 3–5 objectives which should be as SMART as possible on what you aim to achieve [Specific; Measurable; Achievable; Realistic; Time-bound].

Back to the top

---

Step 2: Formative or Summative Evaluation

Next up is think about the key purpose of your evaluation, is this principally:

• Formative evaluation: gathering data, evidence and reflections on the successes and challenges and lessons learnt as the project develops and then making changes either:
  • in ‘real time’ to enhance the project as it progresses, as part of continuous improvement
  • or to run this as a pilot and to inform and shape future similar engagement activities.
• Summative evaluation: gathering evidence of the outcomes and impacts of the project that are captured, synthesised, interpreted and reflected upon; and typically reported on once the project has been completed including: what happened; what outcomes resulted (i.e., changes and benefits that occurred as a result of the project) and why.

Many evaluations are a blend of both formative and summative evaluation.

Back to the top

---

Step 3: Evaluation Questions

Next up is to explore and articulate 3-5 clear and focused Evaluation Questions. These are the ‘high-level’ questions which capture: what is it that the project team really want to find out from the evaluation and why?

Back to the top

---

Step 4: Outputs and Outcomes

The next step is to write down the anticipated outputs (activities to take place/ resources to be produced) and the key outcomes (benefits or changes) that you hope to see happening as a result of the project and on whom or what.

Bearing in mind that public engagement aims to result in mutual benefit, so as well as outcomes on the publics, you can also explore outcomes on the researchers involved and, on the research, itself, and outcomes for partner organisations or your department.

Example outcomes from public and community engagement

Changes/ benefits to the publics/ communities involved	• Thinking/ Feeling: Changes to how people feel (their experiences); their understanding (learning or attitude/perception change) or their motivations and aspirations. • Capacity Building: Enhancing or gaining skills and knowledge; empowerment. • Behaviour: Taking action/ doing something differently.
Changes/benefits to the researchers or the research	This could be researchers building capacity in public engagement; enrichment and positive experiences through their participation such as increased motivation for their research; building networks; or the engagement resulting in setting or shaping research questions or influencing the conduct; analysis or sharing of the research.
Changes/benefits to departments or partner organisations	This might include positive changes in public engagement culture; policies or practice; sharing lessons learnt; or stronger relationships developed and plans in place for new partnership projects.

The articulated outcomes are not targets on which projects should be judged ‘from on high’ to be a success or failure. Instead, they provide a baseline for you to reflect upon as part of your evaluation, to explore if the objectives and outcomes were achieved, exceeded or did not occur; what changes took place and why and what did we learn from that?

Back to the top