Evaluation of Leading to Deliver

APPENDIX 2: TOPLINE FINDINGS (ONLINE SURVEY) - LINE MANAGERS

Evaluation of Leading to Deliver
Online Survey
(Line Managers)
TOPLINE

Technical summary

The Scottish Government asked York Consulting to carry out a confidential survey among all employees who have participated in the Leading to Deliver Programme. Line Managers to participants of the 'Leading to Deliver' programme were been invited to take part.

The survey was conducted online and emails were sent to each line manager on 25 ^th March 2008 with a unique link to the survey. Reminder emails were sent on: 7 ^th April, 15 ^th April , 17 ^th April and 28 ^th April. The deadline was extended until Friday 9th May.

Online survey response rate:

Total number of emails sent with individual links	123
Total surveys received (on 9 ^th May)	43
Response rate	35%

This topline presents the interim result from the evaluation of the Leading to Deliver programme. The topline is based on 43 responses from line managers of current and previous participants across the 5 cohorts, unless otherwise stated.

Data are unweighted and the percentages for each category are given. Where percentages do not add up to 100% this may be due to rounding or the inclusion of multiple responses in the question answers. Any questions not based on the full base of 43 will be indicated and their base shown, this would be due to routing within the questionnaire.

The following symbols are used in this topline:

* percentage lower than one but not nil
- nil value

SECTION ONE - APPLICATION & SELECTION

Q1. How did you first become aware of the Leading to Deliver programme? PLEASE TICK ALL THAT APPLY
	%
Through staff I line manage	53
Through other colleagues	37
Intranet	5
Word of mouth	16
Training & Development Department	19
Advertisement	16
Internal publication	2
H R Department	5
Other (please specify):_____________________________	7
Don't know	3

*Q2. How informed did you feel during* the application process? PLEASE TICK ONE BOX ONLY**
	%
Fully informed	35
Fairly informed	42
Neither informed nor uninformed	14
Not well informed	9
Not at all informed	-
Don't know/no opinion	-

Q3. Did you attend a line manager's workshop before the programme began? PLEASE TICK *ONE* BOX ONLY
	%
Yes	40
No	56
Don't know/no opinion	4

*Q4. And, how informative, if at all, did you find this? PLEASE TICK ONE* BOX ONLY**
(Base: All those who attended the line manager's workshop (17))	%
Very informative	29
Quite informative	71
Neither informative nor uninformative	-
Not very informative	-
Not all informative	-
Don't know/no opinion	-

Q5(a) Why did you want your employees to go on the Leading to Deliver Programme? PLEASE TICK ALL THAT APPLY
*Q5(b) And, what was the main* reason for sending them on the Leading to Deliver programme? PLEASE TICK ONE** BOX ONLY
	(a)	(b)
	%	%
To help their career progression	60	9
To make them a better leader	91	49
To help them implement the 'Changing Lives' recommendations	33	9
They recently became a line manager	7	-
To help them gain a qualification	21	2
To help them to gain registration with the Scottish Social Services Council	19	2
To help them learn about 'change' management	65	9
To help them address specific challenges in their work	58	9
To increase their confidence	58	2
The programme has a good reputation	33	2
Other (please specify) _________________________	4	2
Completed the course myself recommended/encouraged it	5	-
Don't know	2	2

Q6(a) Why did you want your employees to go on the Leading to Deliver Programme? PLEASE TICK ALL THAT APPLY
*Q6(b) And, what was the main* reason for sending them on the Leading to Deliver programme? PLEASE TICK ONE** BOX ONLY
	(a)	(b)
	%	%
To help their career progression	60	9
To make them a better leader	91	49
To help them implement the 'Changing Lives' recommendations	33	9
They recently became a line manager	7	-
To help them gain a qualification	21	2
To help them to gain registration with the Scottish Social Services Council	19	2
To help them learn about 'change' management	65	9
To help them address specific challenges in their work	58	9
To increase their confidence	58	2
The programme has a good reputation	33	2
Other (please specify) _________________________	4	2
Completed the course myself recommended/encouraged it	5	-
Don't know	2	2

Q7. Which, if any, were the major issues that your employees considered prior to applying for the programme? PLEASE TICK *ALL* THAT APPLY
	%
Competing work priorities	79
Residential aspects of the course (time away from home)	30
The e-learning aspect ( i.e. requirement to use IT)	12
The course was formally assessed	16
The amount of self study	40
The amount of work the course entails	58
The postgraduate level of the course	12
Other (please specify) ----------------------------------------------------	4
Don't know/no opinion	5

SECTION TWO - THE LEADING TO DELIVER PROGRAMME

*Q8. Thinking about your experience of the Leading to Deliver programme, how would you rate each of the following? PLEASE TICK ONE* COLUMN FOR EACH ROW.**
	Excellent	Very good	Good	Neither good nor poor	Poor	Very Poor	Don't Know /no opinion	Not applicable
	%	%	%	%	%	%	%	%
The Leading to Deliver programme overall	12	42	35	9	-	-	-	2
The Leading to Deliver programme in comparison to other leadership training programmes you are aware of	9	47	26	12	-	-	5	2
Leading to Deliver in terms of its relevance to social work services	12	49	28	7	-	2	-	2
Leading to Deliver in terms of its relevance to your employee's particular area of work	9	49	33	9	-	-	-	-
The organisation of the Leading to Deliver programme	12	33	42	9	-	-	5	-
Leading to Deliver in terms of its relevance to the Changing Lives recommendations	9	23	44	7	-	2	12	2

*Q9. What, if any, do you think are the benefits of having a formal qualification as part of the programme? PLEASE TICK ALL* THAT APPLY**
	%
Future career prospects of employees	77
Motivation to complete the programme	79
Programme's reputation across Social Services	74
Sense of achievement for your employee	88
Job security for your employee	5
Other (specify)----------------------------------------------------	4
None at all	2
Don't know/no opinion	2

Q10 Based on your employee's feedback after they had completed Leading to Deliver, how satisfied or dissatisfied were they with the following aspects of the programme? PLEASE TICK ONE COLUMN FOR EACH ROW.
	Very Satisfied	Fairly Satisfied	Neither satisfied nor dissatisfied	Fairly dissatisfied	Very dissatisfied	Don't know
	%	%	%	%	%	%
Programme overall	40	51	7	2	-	-
Design of the programme	19	72	7	-	-	2
Delivery of the programme	19	67	7	5	-	2
Residential component	9	60	26	2	-	2
E learning	12	49	28	9	-	2
Course materials	23	63	7	2	-	5
Content of modules	33	56	5	2	-	5
Level at which training was pitched	28	51	14	2	-	5
Balance between different modes of study	14	65	16	-	-	5
Quality of facilitators	23	53	14	2	-	7
Quality of feedback employees received on their progress	12	63	14	7	2	2
Opportunities for networking across social services	42	53	5	-	-	-

Q11. Do you have any other comments (either positive or negative) about the programme based on what you know of your employee's experience? PLEASE WRITE IN FULL.
	%
No comment	42
A positive experience	14
Great opportunity for staff development	7
Inconsistencies with assignment marking	7
Taxing but beneficial	5
Benefits in this programme are often evidenced in the long term	5
Other	19

Q12 (a) Did your employee/s use a mentor during the course of the programme? PLEASE TICK *ONE* BOX ONLY
Q12 (b) Did your employee/s act as a mentor at any time since the programme's inception? PLEASE TICK *ONE* BOX ONLY
Q 12 ( c ) Do you think that mentoring should be a formal structure of the programme in going forward in the future? PLEASE TICK *ONE* BOX ONLY
	(a)	(b)	( c )
	%	%	%
Yes, external mentor	7	-	23
Yes, internal mentor	51	26	37
No	26	58	21
Don't Know	16	16	19

ALL THOSE WHO SAID 'YES' AT Q12 (A)

*Q13. And how useful, if at all, is the mentoring system? PLEASE TICK ONE* BOX ONLY**
(Base: All who said their employee used a mentor (22))	%
Very Useful	32
Fairly useful	56
Neither useful or not useful	4
Not very useful	-
Not at all useful	-
Don't know	8

*Q14. Here are some statements about the Leading to Deliver programme, please indicate the extent to which you agree or disagree with each. PLEASE TICK ONE* COLUMN FOR EACH ROW.**
	Strongly agree	Tend to agree	Neither /Nor	Tend to disagree	Strongly disagree	Don't Know/no opinion
	%	%	%	%	%	%
It was pitched at the right level for my employee/s	28	56	12	5	-	-
My employee/s had to overcome barriers to take part in the programme	2	40	28	26	5	-
The Leading to Deliver Programme was a good use of my employee's time	47	37	12	2	-	2
The fact that the course lead to a formal qualification is a benefit to my organisation.	35	49	14	-	2	-
My employee/s found it difficult to fit the course around their existing work priorities	14	44	21	19	2	-
If there was not a residential aspect to the course more people would participate	9	12	30	28	9	12
I think there have been barriers to my employee/s applying their learning in the workplace	7	16	26	33	19	-
Having a mentor throughout the programme provided major benefits to my employee/s	9	30	33	5	5	19
The course met my expectations	28	49	19	-	-	5
I would recommend the programme to others	51	37	9	2	-	-
I was aware of the importance of line manager support at all stages of the programme to maximise learning	44	42	9	2	-	2

Q15. In what way, if at all, do you think the programme could be improved? PLEASE WRITE IN FULL.
	%
No comment	16
Regionally based	5
Remodelling the programme to allow for non residential participation	5
Provide formal feedback throughout duration of the course	5
Programme needs to reflect on individual needs and will therefore always be subject to change	5
The use of the mentor as a compulsory part of the course	5
Ensure quality of facilitator is consistent	5
Greater linkage with Line Manager	5
Involve more professional disciplines	5
Other	38
Don't know	19
No reply	7

SECTION 3 IMPACT OF TRAINING AND PERFORMANCE MANAGEMENT

Q16 Thinking about the impact that participation on the Leading to Deliver programme has had, to what degree, if any, have your employee/s developed in the following? PLEASE TICK ONE COLUMN FOR EACH ROW
	Improved a lot	Improved slightly	Stayed the same	Got slightly worse	Got a lot worse	Don't know
	%	%	%	%	%	%
Their leadership style	42	37	16	-	2	2
Their skills to be an effective leader	40	40	16	-	2	2
Their skills to be a strategic manager	42	40	14	-	2	2
Their skills to be a leader of change	53	28	14	-	2	2
Their ability to learn from others	42	33	23	-	-	2
Their ability to delivery better quality services	19	63	14	-	-	5
Resource management	12	47	37	-	-	5
Their skills to train other staff	14	58	23	-	-	5
Effective partnership working	30	42	26	-	-	2
Their self confidence	37	42	16	-	2	2
Their understanding of the Changing Lives policy	37	42	16	-	-	5
Level of confidence to effectively use the skills learned	44	35	16	2	-	2

Q17 Thinking about the impact the training has had on your employee/s and your organisation, how much do you agree or disagree with the following statements? PLEASE TICK *ONE* BOX ONLY IN EACH COLUMN FOR EACH ROW
	Strongly agree	Tend to agree	Neither	Tend to disagree	Strongly disagree	Don't Know/no opinion
	%	%	%	%	%	%
My employee/s have used many of the skills and techniques they learned on the programme	26	51	14	5	-	5
My employee/s have not used the programme in their day-to-day work as much as I thought they would	2	16	23	40	16	2
My employee/s have shared learning with other members of staff	21	51	16	5	2	5
The programme has increased their appreciation of priorities and pressures on others	23	42	23	7	2	2
The programme has given them a better appreciation of the needs of service users	2	33	56	5	2	2
The programme has made them more likely to ask for support from colleagues and other professionals	2	49	37	7	-	5
Staff face barriers in using what they have learned back at work.	2	23	28	30	14	2
The programme has improved their negotiating skills	7	49	30	7	-	7
The programme has helped them to understand how they can achieve change	23	56	14	2	-	5
The programme has made them more assertive in his/her work	9	42	42	5	-	2
The programme has improved them ability to work in a multidisciplinary group	12	47	37	2	-	2
The programme has had a lasting effect on their working behaviour	16	42	30	2	2	7
The programme has given them a vision of how things should change in the future	14	56	21	2	2	5
The programme has made day-to-day work more frustrating as staff cannot adopt the changes they want due to internal structures	16	-	35	26	16	7
They still use the materials provided on the course	14	56	14	-	-	16
Their learning will benefit this organisation	28	58	7	-	2	5
Their learning will benefit the sector in which we work	26	58	9	-	2	5
Their learning will benefit service users	21	63	9	-	2	5
Their participation in the programme has been a factor in them obtaining promotion	2	26	49	7	7	9
They have obtained registration with the Scottish Social Services council as a result of the programme	5	12	37	9	19	19

Q18. In what way, if at all, have your employee/s changed their working practices as a result of participating in Leading to Deliver? PLEASE WRITE IN FULL THE EXTENT TO WHICH THE PROGRAMME HAS MADE A CHANGE.
	%
Haven't changed	14
Increased confidence	14
Consistency of approach/direction	14
A more disciplined approach to leadership	7
More self aware	5
More team involvement	5
Managing change effectively	5
More engagement in strategic planning agenda	5
More challenge to the way the organisation is led and managed	5
Other	20
Don't Know	9
No Reply	9

SECTION 4 VALUE FOR MONEY

Q19 Some of the current elements of delivering the Leading to Deliver programme are costly. How important is it that the programme retains the following elements in the future? PLEASE TICK *ONE* BOX ONLY IN EACH COLUMN FOR EACH ROW
	Very important	Fairly important	Neither important/nor unimportant	Fairly unimportant	Not at all important	Don't Know/no opinion
	%	%	%	%	%	%
Residential aspects	14	33	30	9	5	9
E-learning	26	40	16	5	5	9
Facilitators	44	51	2	-	-	2
Accreditation	56	35	5	-	2	2

Q20 The cost of the programme is approximately £4300 per applicant. On a scale of 1 - 10, how much do you think the overall benefits of the programme outweigh the high costs, if at all? 1 = costs are greater than the benefits; 10 = benefits are greater than the costs. PLEASE TICK ONE BOX ONLY.
Scale	1	2	3	4	5	6	7	8	9	10
%	9	5	7	2	7	5	21	26	5	14

Q21 The cost of the current design of the programme means that it has limited reach and impact. The programme currently has around 100 participants per year. In order to maximise reach to a wider workforce which, if any, of the following design options might be effective in the future development of the programme? PLEASE TICK *ONE* BOX ONLY
	%
Re-organise the location of face-to-face components to regional or local centres such as a local college	44
More content delivered through distance learning ( e.g. study packs; e-learning) but with more local tutor support	26
None	12
Re-organise the structure of the face-to-face components ( i.e. hold fewer residential components but longer blocks of study)	9
Don't know/no opinion	9

Q22. What else, if anything, could be done to ensure learning from the programme could have a broader reach without incurring greater cost? PLEASE WRITE IN FULL
	%
No suggestion/comments	21
Use more local delivery methods/local networks e.g. newsletters	19
Have training courses in local areas	14
More distance/e-learning/self taught	12
Support network needed after course has finished- continue self study	12
Use successful participants as mentors/tutors	7
Find a sponsor to reduce costs	5
Follow up reports	5
Other	18
Don't know	16

Q23. If, in order to ensure that employees within your organisation were able to participate in the programme in the future, you had to fund the programme, how much, if anything, would your company be prepared to contribute? PLEASE TICK ONE BOX ONLY
	%
Nothing	7
Up to £500	7
£501 - 1,000	9
£1,001 - 1,500	12
£1,501 - 2,000	7
£2,001 - 2,500	9
£2,501 - 3,000	2
£3,001 - 3,500	-
£3,501 - 4,000	-
£4,001 - 4,500	2
£4,501 - 5,000	-
Don't know	44

SECTION 5 ABOUT YOU

York Consulting promises that your individual questionnaire will never be linked to you as an individual. The views expressed will depend on a number of factors, e.g. your job function. The information below will be used to add relevance to the information provided in the questionnaire however, the data will be analysed in such a way that will not allow you to be identified individually.

*A. Gender. PLEASE TICK ONE* BOX ONLY**
		%
Male		47
Female		53
*B. Age. PLEASE TICK ONE* BOX ONLY**
		%
Under 25 years		-
25-34 years		2
35-44 years		9
45-54 years		44
55+		44

*C. How many employees have you had on the programme? PLEASE TICK ONE* BOX ONLY**
	%
Only one	28
2 - 5	53
6 - 10	14
11 - 20	-
21 - 25	-
Over 25	5

D. In which cohorts did your employee/s participate on the Leading to Deliver Programme? PLEASE TICK ALL BOXES THAT APPLY
	%
Cohort 1 - 2003-2004	37
Cohort 2 - 2004-2005	51
Cohort 3 - 2005-2006	56
Cohort 4 - 2006-2007	65
Cohort 5 - 2007-2008	33
*E. Have you participated in the programme yourself? PLEASE TICK ONE* BOX ONLY**
		%
Yes		30
No		70

*F. In which cohort did you participate on the Leading to Deliver Programme? PLEASE TICK ONE* BOX ONLY**
	%
Cohort 1 - 2003-2004	31
Cohort 2 - 2004-2005	31
Cohort 3 - 2005-2006	23
Cohort 4 - 2006-2007	-
Cohort 5 - 2007-2008	15

*G. Length of service in current post? PLEASE TICK ONE* BOX ONLY**
	%
Less than 12 months	-
Over 1 year up to 2 years	5
Over 2 years up to 5 years	28
Over 5 years up to 10 years	42
Over 10 years	26

*H. How many employees work within your organisation? PLEASE TICK ONE* BOX ONLY**
	%
Less that 10	-
11-50	7
51-100	7
101-250	9
251-500	9
Over 500	67

*I. Location of your organisation? PLEASE TICK ONE* BOX ONLY**
	%
Aberdeen City Council	7
Aberdeenshire Council	5
Angus Council	9
Argyll & Bute Council	2
Clackmannanshire Council	-
Dumfries & Galloway Council	-
Dundee City Council	2
East Ayrshire council	-
East Dunbartonshire Council	2
East Lothian Council	2
East Renfrewshire Council	-
Edinburgh City Council	23
Falkirk Council	2
Fife Council	-
Glasgow City Council	23
Highland Council	5
Inverclyde Council	2
Midlothian council	-
Moray council	-
North Ayrshire Council	2
North Lanarkshire Council	-
Orkney Council	-
Perth & Kinross Council	2
Renfrewshire Council	2
Scottish Borders Council	-
Shetland Islands Council	-
South Ayrshire Council	-
South Lanarkshire Council	2
Stirling Council	5
West Dunbartonshire Council	-
West Lothian Council	-
Western Isles Council	-

*J(i) Which of the following sectors have you ever worked in? PLEASE TICK ALL* THAT APPLY**
*J(ii) Which sector do you currently work within? Please tick one* box only**
*J(iii) Which sector have you spent the majority of your career within? Please tick one* box only**
*J(iv)Which sector did you work within when you were doing the Leading to Deliver Programme? Please tick one* box only**
	(i) Ever worked in	(ii) Currently work in	(iii) Spent majority of career within	(iv) While on Leading to deliver
	%	%	%	%
Local Authority - Social Work Services Department	77	37	63	54
Local Authority - Housing association	5	-	2	-
Local Authority - Other department	23	5	2	-
Scottish Government	-	-	-	-
Care Commission	2	-	-	-
National voluntary organisation	42	30	14	31
Local voluntary organisation	37	19	9	8
Religious group	7	-	-	-
Private Housing Association	5	5	-	-
SACRO	2	2	2	8
Local Regeneration Partnerships	-	-	-	-
NHS Scotland	12	-	2	-
Probation service	5		2
Other (please specify) ___________________	20	2	6	-

*K. Current Job Role Job role when you commenced Leading to Deliver? Please tick one* box only**
(Base: 13)	%
Senior management	38
Middle management	54
Junior management	-
Senior employee	8
Employee	-
Trainee	-

« Previous | Contents | Next »

The Scottish Government

Research

On this page:

Evaluation of Leading to Deliver

APPENDIX 2: TOPLINE FINDINGS (ONLINE SURVEY) - LINE MANAGERS