The Evaluation Works online toolkit launched in March 2016, followed by a complementary two-hour workshop.
Both were the result of collaborative work between the West of England AHSN, CLAHRC West and Avon Primary Care Research Collaborative (APCRC) in their drive to promote a culture of evaluation for health services in the region.
We have come a long way since then, although there is still much to do.
The West of England ASHN recently evaluated that toolkit. Website analytics showed it was being regularly used by both new and returning users, finding the toolkit through signposting links, such as Twitter posts, but also through Google searches. We wanted to know more, for example:
- Did Evaluation Works teach or refresh knowledge to show the user how to evaluation a service?
- Did existence of Evaluation Works increase a user’s confidence to talk to colleagues about evaluation?
In November 2017, a survey found favourable results, albeit with a small response (n=11).
- 64% (n=7) found the Evaluation Works toolkit useful.
- Participants found the case studies most useful, closely followed by step 4: do, evaluation cycle, step 5: review and act and contacts.
- 100% (n=8) of respondents had recommended the Evaluation Works toolkit to a colleague.
- The greatest reported benefit of using the Evaluation Works toolkit was that it helped 75% (n=6) of participants to learn new things about planning or doing an evaluation. This was closely followed by ‘It was a helpful refresher’ (62.5%, n=5) and ‘It gave me confidence to talk to colleagues about evaluation’ (62.5%, n=5 participants).
As a result, we will continue to promote the Evaluation Works online toolkit, with some new content planned for the new year. This will include online video training resources, and new templates for evaluation planning and reporting.
The West of England AHSN are now considering evaluating the sister toolkit, Evidence Works, also launched in 2016.
Posted on December 4, 2017
