On this page:

Evaluation of Leading to Deliver

« Previous | Contents | Next »

Listen

APPENDIX 1: TOPLINE FINDINGS (ONLINE SURVEY) - PARTICIPANTS

Evaluation of Leading to Deliver
Online Survey
(Participants)
Topline

Technical Summary

The Scottish Government asked York Consulting to carry out a confidential survey among all employees who have participated in the Leading to Deliver Programme. This is part of a wider evaluation of the programme which also includes face-to-face depth interviews with a range of stakeholders involved in Leading to Deliver.

The survey was conducted online and emails were sent to each participant on 6 th March 2008 with a unique link to the survey. Reminder emails were sent on: 17 th March and 25 th March. The deadline was extended by a week and the survey closed on Monday 31 st March.

Online survey response rate;

Total number of emails sent with individual links

395

Total surveys received:

196

Response rate

51%


This topline presents the final result from the evaluation of the Leading to Deliver programme.

The topline is based on 196 responses from current and past participants across the 5 cohorts.

Data are unweighted and the percentages for each category are given. Where percentages do not add up to 100% this may be due to rounding or the inclusion of multiple responses in the question answers. Any questions not based on the full base of 196 will be indicated and their base shown, this would be due to routing within the questionnaire.

The following symbols are used in this topline:

* percentage lower than one but not nil
- nil value

SECTION ONE - A PPLICATION & SELECTION

Q1. How did you first become aware of the Leading to Deliver programme?
PLEASE TICK ALL THAT APPLY

%

Through line manager

56

Through colleagues

24

Intranet

2

Word of mouth

14

Training & Development Department

11

Advertisement

4

Internal publication

8

H R Department

2

Other (please specify):_____________________________

8

Don't know

1

Q2. How informed did you feel during the application process? PLEASE TICK ONE BOX ONLY

%

Fully informed

36

Fairly informed

52

Neither informed nor uninformed

5

Not well informed

7

Not at all informed

1

Q3(a) Why did you want to participate in the Leading to Deliver Programme? PLEASE TICK ALL THAT APPLY

Q3(b) And, what was the main reason for participating in the Leading to Deliver programme? PLEASE TICK ONE BOX ONLY

(a) %

(b) %

To make me a better leader

88

58

To help my career progression

56

6

To learn about 'change' management

56

6

To address specific challenges in my work

52

10

To increase my confidence

51

5

To gain a qualification

38

7

To help me implement the changing lives recommendations

24

2

I recently became a line manager

9

3

To gain registration through the Scottish Social Services Council

8

3

Other (specify) _________________________

5

1

Don't know

-

-

Q4. Which, if any, were the major issues that you considered prior to applying for the programme?

PLEASE TICK ALL THAT APPLY

%

Competing work priorities

79

The amount of work the course entails

62

The amount of self study

42

The course was formally assessed

23

Residential aspects of course

22

The postgraduate level of the course

18

The e-learning aspect ( i.e. requirement to use IT)

9

Other (please specify) ----------------------------------------------------

4

Don't know/no opinion

3

None/ No issues

2

Section Two - THE Leading to Deliver Programme

Q5. Having participated in the Leading to Deliver programme, how would you rate each of the following? PLEASE TICK ONE COLUMN FOR EACH ROW.

Excellent

Very good

Good

Neither good nor poor

Poor

Very Poor

Don't Know /no opinion

Not applicable

%

%

%

%

%

%

%

%

The Leading to Deliver Programme overall

35

44

18

2

2

-

-

-

The Leading to Deliver programme in comparison to other leadership development programmes you are aware of

26

32

10

3

1

1

21

8

Leading to Deliver in terms of its relevance to social work services

29

46

19

5

1

-

1

-

Leading to Deliver in terms of its relevance to your particular area of work

22

40

29

7

1

1

-

-

The organisation of the Leading to Deliver programme

23

50

21

5

1

-

-

-

Leading to Deliver in terms of its relevance to the Changing Lives recommendations

14

40

29

11

2

2

2

2

Q6. What, if any, do you think are the benefits of having a formal qualification as part of the programme? PLEASE TICK ALL THAT APPLY

%

Sense of achievement

86

Motivation to complete the programme

65

Programme's reputation across Social Services

65

Future career prospects

65

Other (specify)----------------------------------------------------

8

Job security

6

None at all

1

Don't know/ no opinion

1

Q7. How important is it that the course leads to an accreditation/qualification?

PLEASE TICK ONE BOX ONLY

%

Very Important

69

Fairly important

23

Neither

4

Fairly unimportant

2

Not at all important

1

Don't know

Q8. Thinking about the delivery of the Leading to Deliver Programme, how satisfied or dissatisfied are you with each of the following? PLEASE TICK ONE COLUMN FOR EACH ROW.

Very Satisfied

Fairly Satisfied

Neither satisfied nor dissatisfied

Fairly dissatisfied

Very dissatisfied

Not applicable

%

%

%

%

%

%

(i) Amount of facilitators' support

57

30

9

4

-

-

(ii) Quality of facilitators' support

60

27

6

7

1

-

(iii) Accessibility of facilitators

51

32

15

1

1

1

(iv) Way in which facilitators dealt with questions/issues

51

35

7

5

2

-

(v) Quality of External Speakers' presentation (within Social Work)

12

58

24

5

1

-

(vi) Quality of External Speakers' presentation (outwith Social Work)

13

56

24

5

2

-

(vii) Quality of feedback received about your progress

19

54

20

5

2

-

Q9. Thinking about the design of the Leading to Deliver Programme, how satisfied or dissatisfied are you with each of the following? PLEASE TICK ONE COLUMN FOR EACH ROW.

Very Satisfied

Fairly Satisfied

Neither satisfied nor dissatisfied

Fairly dissatisfied

Very dissatisfied

Not applicable

%

%

%

%

%

%

Briefing prior to course

26

52

16

5

1

1

Course materials

57

38

4

-

1

-

Use of Case Studies

15

57

20

5

-

3

Content of Modules

40

53

5

2

-

-

Balance between different modes of study eg residential, e-learning, self study

37

51

8

2

2

-

The level at which training is pitched

47

45

5

1

2

-

Q10. Thinking about each of the modules delivered throughout the course, how would you rate each of these? PLEASE TICK ONE COLUMN FOR EACH ROW.

Excellent

Very good

Good

Neither good nor poor

Poor

Very Poor

Don't Know /no opinion

%

%

%

%

%

%

%

1. Changing to Lead;

44

39

13

2

2

-

1

2. Leading & Influencing Change;

39

43

15

2

1

-

1

3. Leading Change in Service Delivery

22

42

25

6

4

1

1

4. Leading Delivery through Effective Relationships.

29

44

19

4

2

1

1

ALL THOSE WHO HAVE SAID POOR/VERY POOR AT Q 10

Q11. (i) Why do you think that? PLEASE WRITE IN FULL.

(Base All those who rated 'Changing to Lead' as Poor (3))

%

Not relevant in terms of day to work

33

Advice/input from group facilitator poor

33

Material too simplistic - not pitched at suitable level

33

Poor constructed model

33

Q11. (ii) Why do you think that? PLEASE WRITE IN FULL.

(Base: All those who rated 'Leading & Influencing Change' as Poor (2))

%

Not relevant in terms of day to work

50

No reply

50

Q11. (iii) Why do you think that? PLEASE WRITE IN FULL.

(Base: All those who rated 'Leading Change in Service Delivery' as Poor (9))

%

Found it confusing/unclear/not explained clearly enough

22

Did not achieve the stated learning outcomes/didn't learn much

22

Not relevant in terms of day to day work

11

Advice/input from facilitator poor

11

Input in the smaller group was very general but had high expectations

11

Tutors were unclear what they were looking for

11

Felt there was a lack of clarity to what level to pitch this element at

11

Q11. (iv) Why do you think that? PLEASE WRITE IN FULL.

(Base: All those who rated 'Leading Delivery through effective Relationships' as Poor (5))

%

Didn't go into issues in sufficient depth to improve knowledge/skills

40

Found it confusing/unclear/not explained clearly enough

20

Not sufficiently informed about relationships in the social services world

20

Not enough content

20

Q12. Thinking about the residential element of the Leading to Deliver Programme, how satisfied or dissatisfied are you with each of the following? PLEASE TICK ONE COLUMN FOR EACH ROW.

Very Satisfied

Fairly Satisfied

Neither satisfied nor dissatisfied

Fairly dissatisfied

Very dissatisfied

Not applicable/ Don't Know

%

%

%

%

%

%

Location

29

52

14

3

2

1

Length of stay

32

51

11

4

2

2

Accommodation

12

44

23

14

5

2

Travel, ( i.e. distance from home)

28

41

24

5

2

-

Social aspects

30

41

26

1

1

2

Use of Syndicate Group

50

30

12

4

4

-

Scheduling of the residential aspect

24

52

18

4

2

1

Volume of work

15

65

15

5

1

-

Pace of the course

23

61

10

6

1

-

Use of evenings

13

47

26

10

2

2

Networking across Social Services

26

49

19

4

1

1

Q13 To what extent, if at all, have you used the e-learning facility? PLEASE TICK ONE BOX ONLY

%

A great deal

5

A fair amount

22

Just a little

34

Hardly any

23

Not at all

16

Don't know

1

Q14(a) Which of these e-learning elements of the Leading to Deliver programme did you use? PLEASE TICK ALL THAT APPLY

Q14 (b) Thinking about the e-learning elements you used, how satisfied or dissatisfied are you with each of them? PLEASE TICK ONE COLUMN FOR EACH ROW WHICH APPLYS

(A) Use

(b) Very Satisfied

(b) Fairly Satisfied

(b) Neither satisfied nor dissatisfied

(b) Fairly dissatisfied

(b) Very dissatisfied

Don't Know

%

%

%

%

%

%

%

Guidance notes (Base:163)

67

22

63

12

2

-

-

Access to journals/books (Base:130)

80

27

53

12

5

2

2

Online facility as a source of materials (Base:90)

55

19

54

19

6

2

-

Online facility as a source of learning (Base:48)

29

21

60

15

2

-

2

Q15 The current design of the programme means that it has limited reach and impact. In order to maximise reach to a wider workforce which, if any, of the following design options might be effective in the future development of the programme? PLEASE TICK ONE BOX ONLY

%

Re-organise the location of face-to-face components to regional or local centres such as a local college

41

More content delivered through distance learning ( e.g. study packs; e-learning) but with more local tutor support

19

Re-organise the structure of the face-to-face components ( i.e. hold fewer residential components but longer blocks of study)

12

None

20

Don't know/no opinion

9

Q16 (a) Did you use a mentor during the course of the programme? PLEASE TICK ONE BOX ONLY

Q16 (b) Have you acted as a mentor at any time since the programme's inception? PLEASE TICK ONE BOX ONLY

Q 16 ( c ) Do you think that mentoring should be a formal structure of the programme in going forward in the future?

PLEASE TICK ONE BOX ONLY

(a)

(b)

( c )

%

%

%

Yes

45

20

59

No

54

80

21

Don't No

1

-

20

ALL THOSE WHO SAID 'YES' AT Q16 (A)

Q17. And how useful, if at all, did you find the mentoring system? PLEASE TICK ONE BOX ONLY

(Base: 89)

%

Very Useful

31

Fairly useful

53

Neither useful or not useful

10

Not very useful

4

Not at all useful

1

Q18. Here are some statements about the Leading to Deliver programme, please indicate the extent to which you agree or disagree with each. PLEASE TICK ONE COLUMN FOR EACH ROW.

Strongly agree

Tend to agree

Neither

Tend to disagree

Strongly disagree

Don't Know/no opinion

%

%

%

%

%

%

It was pitched at the right level for me

43

48

4

3

2

-

Leading to deliver is relevant to my job

66

28

4

1

1

-

I had to overcome barriers to take part in the programme

18

33

19

19

10

1

The fact that the course lead to a recognised qualification made me more determined to work hard

41

37

15

5

2

-

The syndicate groups provided a great support mechanism

50

27

13

7

4

-

The balance was right between supported and self study

34

48

12

5

1

-

The Leading to Deliver Programme was a good use of my time

56

38

4

1

2

-

The fact that the course lead to a formal qualification did not matter to me

3

12

11

32

39

4

My line manager was supportive of me during the course

31

28

23

11

6

2

It was difficult to fit the course around my existing work priorities

25

42

17

10

6

1

The written materials for each of the modules could be better

1

11

28

36

23

1

I still keep in touch with others on my course

10

28

18

21

20

3

If there was not a residential element of the course more people could participate

5

27

27

20

13

8

I think there will be barriers to applying my learning from Leading to Deliver back in the work place

7

23

13

30

22

4

My line manager was supportive of me after the course

29

28

20

12

8

3

The facilitators provided extra support if needed

29

38

24

6

1

2

Having a mentor throughout the programme had major benefits to me

8

19

22

12

12

27

The course met my expectations

42

47

7

3

2

-

I would recommend the programme to others

63

31

5

1

1

-

SECTION 3 IMPACT OF TRAINING AND PERFORMANCE MANAGEMENT

Q19 Thinking about the impact that participation on the Leading to Deliver programme has had, to what degree, if any, have you developed in the following? PLEASE TICK ONE COLUMN FOR EACH ROW

Improved a lot

Improved slightly

Stayed the same

Got slightly worse

Got a lot worse

Don't Know

%

%

%

%

%

%

My leadership style

51

46

3

-

-

-

Skills needed to be an effective leader

49

47

4

-

-

-

Skills needed to be a strategic manager

48

45

7

-

-

1

Skills to be a leader of change

57

38

5

-

-

-

Ability to learn from others

39

40

20

-

-

1

Delivery of better quality services

29

47

22

-

-

3

Resource management

12

49

36

1

-

2

Skills to train other staff

26

52

22

1

-

1

Effective partnership working

33

45

19

1

-

2

Self confidence

43

41

15

1

-

-

Understanding of the Changing Lives policy

41

31

24

1

-

3

Level of confidence to effectively use the skills learned

46

42

12

-

-

-

Q20. Thinking about the impact the programme has had, how much do you agree or disagree with the following statements….?

PLEASE TICK ONE BOX ONLY IN EACH COLUMN FOR EACH ROW

Strongly agree

Tend to agree

Neither

Tend to disagree

Strongly disagree

Don't Know/no opinion

%

%

%

%

%

%

I have used many of the skills and techniques I learned on the programme

32

53

10

5

1

-

I have not used the programme in my day-to-day work as much as I thought I would

4

23

18

37

18

-

I have passed my learning onto other members of staff

18

69

9

2

1

1

The programme has increased my appreciation of priorities and pressures on others

17

50

27

6

1

-

The programme has given me a better appreciation of the needs of service users

11

32

35

16

7

1

The programme has made me more likely to ask for support from colleagues and other professionals

10

39

39

10

2

-

The programme has improved my negotiating skills

16

52

24

7

1

-

The programme has helped me to understand how I can achieve change

37

55

6

2

1

-

The programme has made me more assertive in my work

24

42

26

6

2

-

The programme has improved my ability to work in a multidisciplinary group

16

45

27

9

3

1

The programme has had a lasting effect on my working behaviour

28

56

13

3

1

-

The programme has given me a vision of how things should change in the future

31

50

15

4

1

-

The programme has made day-to-day work more frustrating as I cannot adopt the changes I want to due to internal structures

8

20

25

27

19

1

I still use the materials provided on the course

22

63

9

6

1

-

My learning will benefit my employer

35

56

7

2

1

-

My learning will benefit the sector in which I work

35

55

8

2

1

-

My learning will provide sustainable benefits to service users

24

55

16

4

1

-

Participation in the programme has contributed to my obtaining promotion

9

14

29

16

19

13

I have obtained registration with the Scottish Social Services Council as a result of completing the programme

2

5

19

15

38

21

Q21. In what way, if at all, have you changed your working practices as a result of participating in Leading to Deliver? PLEASE WRITE IN FULL THE EXTENT TO WHICH THE PROGRAMME HAS MADE A CHANGE.

(Base: 196)

%

Managing change more effectively

21

Increased confidence

18

More competent leader/manager

17

Understanding of strategic planning

15

More self aware

13

Delegation

11

More aware of staff needs

9

Put materials from course to practice

9

Improved skills in partnership working/understanding relationships

6

Now have a wide range of tools at my disposal

6

Put techniques learned on course to good use

5

Other

55

Don't know

3

Q22 And finally, in what way, if at all, do you think the programme could be improved? PLEASE WRITE IN FULL.

(Base: 196)

%

No improvement necessary

18

Improve structure e.g. faster paced/condensed/shorter

12

More accessible/open to different levels/roll out to different levels

8

Have a refresher course/follow up

4

More support/guidance

4

Deliver locally

4

Speakers - add no value

3

Shorter residential units

3

E-learning facility was difficult to access/needed more support with it

3

The marking system

3

Stronger connections/involve partner agencies

3

Other

47

Don't know

4

SECTION 4 About You

York Consulting promises that your individual questionnaire will never be linked to you as an individual. The views expressed will depend on a number of factors, e.g. your job function. The information below will be used to add relevance to the information provided in the questionnaire however, the data will be analysed in such a way that will not allow you to be identified individually .

A. Gender. PLEASE TICK ONE BOX ONLY

%

Male

32

Female

68

B. Age PLEASE TICK ONE BOX ONLY

%

Under 25 years

-

25-34 years

3

35-44 years

31

45-54 years

53

55+

13

C(i) When did you start the Leading to Deliver Programme? PLEASE TICK ONE BOX ONLY

C (ii) When did you complete the Leading to Deliver Programme?

PLEASE TICK ONE BOX ONLY

(i) %

(ii) %

Cohort 1 - 2003-2004

16

15

Cohort 2 - 2004-2005

19

18

Cohort 3 - 2005-2006

17

16

Cohort 4 - 2006-2007

16

17

Cohort 5 - 2007-2008

32

31

I did not complete the programme

-

3

C. Length of service in current post? PLEASE TICK ONE BOX ONLY

%

Less than 12 months

9

Over 1 year up to 2 years

11

Over 2 years up to 5 years

39

Over 5 years up to 10 years

27

Over 10 years

14

D. How many employees work within your organisation? PLEASE TICK ONE BOX ONLY

%

Less that 10

3

11-50

9

51-100

4

101-250

5

251-500

13

Over 500

63

Don't Know

4

E. How many employees work within your organisation? PLEASE TICK ONE BOX ONLY

Less that 10

3%

11-50

9%

51-100

4%

101-250

5%

251-500

13%

Over 500

63%

Don't Know

4%

F Location of your organisation? PLEASE TICK ONE BOX ONLY

%

Aberdeen City Council

4

Aberdeenshire Council

4

Angus Council

6

Argyll & Bute Council

1

Clackmannanshire Council

-

Dumfries & Galloway Council

4

Dundee City Council

4

East Ayrshire council

1

East Dunbartonshire Council

-

East Lothian Council

2

East Renfrewshire Council

1

Edinburgh City Council

16

Falkirk Council

3

Fife Council

4

Glasgow City Council

15

Highland Council

3

Inverclyde Council

5

Midlothian council

1

Moray council

3

North Ayrshire Council

2

North Lanarkshire Council

3

Orkney Council

1

Perth & Kinross Council

1

Renfrewshire Council

5

Scottish Borders Council

3

Shetland Islands Council

1

South Ayrshire Council

-

South Lanarkshire Council

5

Stirling Council

3

West Dunbartonshire Council

1

West Lothian Council

2

Western Isles Council

-

G(i) Which of the following sectors have you ever worked in? PLEASE TICK ALL THAT APPLY

G(ii) Which sector do you currently work within? Please tick one box only

G(iii) Which sector have you spent the majority of your career within? Please tick one box only

G(iv)Which sector did you work within when you were doing the Leading to Deliver Programme? Please tick one box only

(i) Ever worked in

(ii) Currently work in

(iii) Spent majority of career within

(iv) While on Leading to deliver

%

%

%

%

Local Authority - Social Work Services Department

80

52

62

54

Local Authority - Housing association

3

2

1

1

Local Authority - Other department

16

2

3

1

Scottish Government

4

1

-

1

Care Commission

5

4

1

4

National voluntary organisation

43

28

19

28

Local voluntary organisation

33

6

9

6

Religious group

1

-

-

-

Private Housing Association

4

1

-

1

SACRO

1

1

-

1

Local Regeneration Partnerships

1

-

-

-

NHS Scotland

15

1

3

1

Other write in: ___________________

23

8

6

5

H. Current Job Role Job role when you commenced Leading to Deliver? Please tick one box only

%

Senior management

18

Middle management

56

Junior management

22

Senior Employee

2

Employee

2

Trainee

-

I. Which, if any, qualifications did you have before completing the Leading to Deliver course? PLEASE TICK ALL THAT APPLY

%

School leaving certificate, NC module, Access Course level, level 2 or level 3, Standard Grade foundation level, City and Guilds Level 1-3

5

Standard Grade (Credit or General), GCSE, Intermediate 1 or 2, SVQ level 1 or 2, GSVQ/ GNVQ foundation or intermediate level (Level 1 or 2), Professional Development Certificate, City and Guilds Level 4-5

54

Higher, Advance Higher, A-Level, CSYS (Certificate of Sixth Year Studies), SVQ Level 3, GSVQ/ GNVQ Level 3, City and Guilds level 6-7

70

HNC (Higher National Certificate), HND (Higher National Diploma), SVQ Level 4, Professional Development Diploma, Certificate/Diploma of Higher Education, City and Guilds Level 8-9

31

Advance Diploma, SVQ Level 5, Professional Development advanced diploma

Ordinary/Bachelors/General/Pass Degree, Honours Degree, Graduate Certificate/Diploma, Masters/Doctorate/PhD

City and Guilds level 10-11

85

Other recognised qualification please specify………………………………..…..

CQSW

12

Other

7

Other non-recognised qualification please specify…………………………………………

-

Don't Know

-

None

-

J. Responsibilities. PLEASE TICK ONE COLUMN FOR EACH ROW

Yes

No

%

%

Do you have sole or joint responsibility for any children under 16 years?

38

62

Do you have sole or joint responsibility to care for someone with a disability or illness?

13

87

K. Have you been promoted since completing the Leading to Deliver programme. PLEASE TICK ONE BOX ONLY

%

Yes

26

No

74

L. During LtD you may have been asked to complete a balance scorecard? PLEASE TICK ONE COLUMN FOR EACH ROW

Yes

No

%

%

Did you complete a balance scorecard?

76

24

Do you have your balance scorecard?

54

46

« Previous | Contents | Next »

Page updated: Thursday, October 2, 2008