Skip to main content

https://digitalinclusion.blog.gov.uk/2016/05/19/evaluate-it-toolkit-weve-completed-our-pilot/

Evaluate IT Toolkit: We've completed our pilot!

Posted by: and , Posted on: - Categories: About digital engagement, Digital Economy, User research

Julia Churchill-Angus on further progress:

In October last year, we launched a 6 month pilot of our Digital Inclusion Outcomes Framework Evaluate IT Toolkit. I’ve been blogging at intervals throughout the process to keep you up to date with our findings and actions.

The months have sped past and now we have officially come to an end of the process, marked by a workshop for all of our ‘pilotees’ to get together and discuss the good, the bad and the ugly of our toolkit document.

The workshop was a big success; it let us discuss our differing experiences of the toolkit, and creative juices were flowing when we asked the group to develop their own ideas on making a Toolkit 2.0.

https://youtube.com/watch?v=ZRSZ8K7b-LM

A few months ago, I summarised the feedback we collected in our first interviews. The good news is that a lot of the points have been reiterated further down the line, so we know that they are important to act on. We have had some extra feedback though:

  • Can we explain the connections between all of the Digital Inclusion Outcomes Framework products better? How do you use them in conjunction?
  • The Toolkit has allowed some organisations to identify and address issues in their usual evaluation processes, it has allowed people to develop a fresh view on evaluation.
  • The evaluation material produced by the toolkit has been successfully combined with complementary qualitative work.
  • Sometimes terminology used in the toolkit can be hard to understand, we should better define these.

Now we’ve gathered all of this rich feedback, we want to properly act on it. In February we made our first changes, editing step three of the toolkit, but now we want to do more. Over the coming months we will consolidate a plan of action, with a view to publish version 2.0 at the end of the year, the perfect christmas present for any keen evaluator!!

Finally and very importantly, I want to say a huge thank you to all of the organisations who have participated in our pilot process (Carnegie UK, Norwich City Council, Carmarthenshire County Council, RNIB, Remploy, L&Q Housing, Community UK, Tinder Foundation) your insights have been invaluable, and essential to take this project forward.

If you have been using the Evaluate IT Toolkit on your own projects, we want to hear from you, and your own views on the good, the bad and the ugly! Get in touch below with your feedback.

Sharing and comments

Share this page