CRG research evaluation training and consultancy

Research Consultancy and Training from CRG

When you draw up your evaluation plan, you will need to make some strategic choices about the type of evaluation which is best for you. There is no single way of planning an effective evaluation: you have to consider what the project is seeking to achieve, what data will be relevant and easy to collect, and lessons you hope to learn.

The main evaluation design options are:

- Summative Evaluating a project as it comes to a conclusion. Does provide learning points for future projects, but limited opportunities for continuous improvement during the lifetime of the project.
- Independent Evaluation Independent evaluators provide an objective view of the project and its achievements. Appropriate resources need to be allocated and the project manager will need to dedicate time to work closely with the evaluator.

- Formative Evaluator works with project throughout its lifespan. Regular feedback helps managers achieve continuous improvement and encourages learning about what works well or less well.
- DIY In-house evaluations can be successful, but take time, proper planning and access to the right skills. An external partner can provide additional resources, train staff and keep the progress of the in-house evaluators on-track.

Key tools and techniques for use as part of your overall evaluation design include:

- Baselines If a project is going to have an impact, knowing where key variables start from is essential. Establishing some baseline positions at the very start of the project's lifespan is easily overlooked but fundamental for an effective evaluation.
- Surveys Well designed surveys collect reliable qualitative and quantitative information, using postal, telephone, face to face, or online techniques. Proper design of samples and asking the right questions are vital. Flexible and easy-to-use research tools - as well as experienced interviewers - make a big difference.
- In-Depth Research Many evaluations need to probe the 'softer' aspects of people's opinions and understanding. Techniques include, face to face interviews, diaries, observations. Good listening skills are essential, with the abilities to 'get behind' the key issues.
- Desk Research Taking a good look at Management Information, Policies, Plans, Statistics, etc: is essential to understand the background to a project and check delivery.
- Counterfactual 'What might have happened if the project hadn't operated?' is a fundamental question for effective evaluation. Evaluation techniques can probe the essential 'what-if?' questions.

- Impacts / Outcomes Project activity and outputs are relatively simple to monitor. Effective evaluation goes beyond this and teases out the all important impacts and outcomes of project interventions.
- Workshops Lively, interactive workshops facilitated by experts can keep stakeholders 'signed up' to the evaluation process - helping them to contribute their own ideas and appreciate the importance of findings.
- Case Studies & Good Practice 'How it works in practice' always attracts attention - particularly from people working in similar projects. Case studies are a key tool through which lessons can be learned and good practice shared.
- Reporting & Dissemination Reports should be easy to read, with carefully analysed findings, and evidence-based conclusions and recommendations. Summaries, press releases, workshops and presentations help publicise and make best use of evaluation findings.

For information on how CRG can help you with your evaluation needs, click on us.