« Previous | Contents | Next »
Listen
Chapter Two Methodology
2.1 The methodology was designed to evaluate two specific aspects to the service - processes and outcomes.
Process evaluation
2.2 The process strand of the evaluation was designed to provide as much information as possible about Incite's processes and practices. The aim was to assess how well the service identified, recruited and retained service users, the quality of its response to service user need and its ability to work successfully with other agencies and services in the Grampian area. The process evaluation included a programme of interviews, observation and data monitoring.
Interviews
2.3 These investigated and compared perceptions and expectations throughout the course of the evaluation. They were completed at timed intervals with staff (3 staff members at 3 timed intervals, 3-4 months apart), service providers (16 completed Time 1 interviews, 9 completed Time 2 interviews), current service users (9 completed Time 1 interviews, 6 completed Time 2 interviews), ex-service users (1 interview).
Data monitoring and service activity
2.4 This gauged the level and quality of monitoring within the service by investigating data collation and reporting. It provided a breakdown of service user profiles including patterns of service use and a measure of service activity in relation to the project's original aims and goals.
Outcome evaluation
2.5 The outcome strand of the evaluation was designed to measure the effectiveness of interventions provided by Incite by monitoring the progress and improvement of service users. This covered changes experienced across a number of areas, such as in patterns of drug use, physical and mental health and in current relationships. Outcome evaluation included a programme of interviews, data monitoring and case studies.
Interviews
2.6 Staff and service provider interviews were used to show changes to the service over the evaluation period. Service user interviews focused on the tangible work staff did with clients. Information was also used from the interviews to gather an indication of service effectiveness.
Data monitoring
2.7 Information from the Orion database, Drugs Action database and pro-formas designed by HFAL supplied information about the current standing of the project with regard to activity levels and specific outcomes.
Case studies
2.8 Case studies were drawn up for all services users who had completed two interviews. They were put together using information from interview transcripts and client case files. They were conducted to provide more robust information for the outcome evaluation by helping to measure change in a small group.
« Previous | Contents | Next »