On this page:

Scottish Survey of Achievement: 2006 Social Subjects (Enquiry Skills) and Core Skills - Supporting Evidence

« Previous | Contents | Next »

Listen

F: Practical Assessment of Core skills results

F.1 Assessing and reporting core skills

The core skills of Working With Others, Problem Solving and ICT were assessed in the practical component of the survey. Assessment was in the context of Social Subjects. More information about the assessment process is available in Annex II.6.

It should be noted that due to logistical constraints, these practical assessments involved relatively small numbers of pupils drawn from a limited sub-sample of the survey schools; typically 3-4 pupils were assessed for each different task type in each school by field officers using performance descriptors. Judgements about pupils' abilities are necessarily subjective, and although the field officers were provided with some training to help improve the consistency of their assessments, their judgements were not subject to moderation and it can be expected that there would be differences between field officers.

The practical assessments were not designed to provide robust national estimates of the three skills investigated, because the numbers of pupils and field officers required to achieve this would be prohibitive and beyond the scope of the SSA. However, the results do represent useful, indicative information for teachers and educationalists for contrast and comparison with the evidence they gather through their own work with pupils. The practical assessments also provide exemplification of practical assessment methods as alternatives to traditional pencil and paper tests, and provide professional development opportunities for teachers.

Throughout the following section, findings are presented as sample statistics only; the results are not weighted to provide estimates for the population.

F.2 Working with others

Table F1 presents the assessments made of pupils' skills when working with others.

Table F1
Results of the assessment of the skills of working with others, by stage
(% pupils rated as indicated for various aspects by field officers)

P3

P5

P7

S2

New ideas

Little or no contribution to discussion

23

14

11

28

Contributes ideas & participates freely in the discussion

59

67

69

52

Contributes most of the ideas

18

19

20

20

Number of pupils assessed

354

341

429

357

Building on others' ideas

No evidence of listening to ideas of others and building on them

15

7

4

11

Some evidence of listening to ideas of others and building on them

49

46

33

46

Listens to others' ideas of others and, for most part, builds on them

36

48

63

43

Number of pupils assessed

352

334

423

343

Motivation

Shows little or no interest in task, ignoring or disrupting others

8

4

3

9

Addresses task and shows some interest in completing the task

32

24

19

33

Shows engagement with the task and is motivated to complete the task

60

72

79

58

Number of pupils assessed

355

329

423

348

The discussion

Takes turns

66

65

69

63

Adopts clear role within group

16

23

23

28

Dominates the discussion

8

8

5

3

Adopts disruptive role or is disengaged

10

4

4

6

Number of pupils assessed

344

337

411

331

The results show that between 70-90% of the pupils assessed contributed ideas within their groups and around 85-95% showed at least some evidence of listening to the ideas of others and building on them. The proportion of pupils who made little contribution to the discussion or showed no evidence of listening to others was higher at P3 and S2 than P5 and P7.

Pupils were in general well motivated, with more than 90% showing at least some interest in completing the task and between 80-90% contributed to the discussion without dominating it or being disruptive.

F.3 Problem solving

Field officers rated entire pupil groups for various aspects of problem solving as they worked together to solve their given problem. The results are shown in Table F2 below.

Table F2
Results of the assessment of problem solving, by stage
(% groups rated as indicated by field officers)

Aspect

Stage

Number of groups assessed

No evidence

Some evidence

Strong evidence

Understanding & exploring the problem

- Explores different ways of tackling the problem

P3

98

24

57

18

P5

96

9

45

46

P7

116

8

39

53

S2

97

34

37

29

- Come to a consensus as to strategy, course of action

P3

98

19

57

23

P5

95

12

35

54

P7

117

3

29

68

S2

101

14

42

45

Resolving the problem

- Critically reflects on the process or strategy, amending or adapting if necessary

P3

97

29

53

19

P5

93

16

39

45

P7

115

10

39

51

S2

97

25

42

33

- Agrees roles/responsibilities within the group.

P3

98

18

50

32

P5

96

11

47

42

P7

118

6

22

72

S2

101

11

42

48

Completing the task

- Task successfully completed

P3

97

5

68

27

P5

94

2

34

64

P7

115

1

27

72

S2

98

2

36

62

At least 95% of the groups at each stage showed at least some evidence of completing their task successfully, although fewer of the P3 groups showed strong evidence of successful task completion than the other stages. For the other aspects, the P7 groups were assessed most positively, followed by the P5 groups.

F.4: Using ICT

Pupils were individually assessed for ICT skills and the summary results are shown in Table F3.

Table F3
Level attainment results for ICT skills, by stage

stage

Number of pupils assessed

(% pupils deemed by field officers to be at indicated levels)

<A

A

B

C

D

E

F

P3

431

4

53

39

4

0

0

0

P5

428

0

12

34

42

11

1

0

P7

479

0

2

6

23

45

19

5

S2

354

0

0

1

11

29

41

19

At P3 most pupils were judged by the field officer to be at level A or better in ICT. Over 40% were judged to be beyond level A. At P5 over 80% were judged to be at level B or better and over half were judged to be at C or better. At P7 almost 70% were judged to be at level D or better with around a quarter beyond level D. At S2, 60% were judged to be at E or better and almost one in five were judged to be at level F.

« Previous | Contents | Next »

Page updated: Wednesday, August 15, 2007