« Previous | Contents | Next »
Listen
F: Practical Assessment of Core skills results
F.1 Assessing and reporting core skills
The core skills of Working With Others, Problem Solving and ICT were assessed in the practical component of the survey. Assessment was in the context of Social Subjects. More information about the assessment process is available in Annex II.6.
It should be noted that due to logistical constraints, these practical assessments involved relatively small numbers of pupils drawn from a limited sub-sample of the survey schools; typically 3-4 pupils were assessed for each different task type in each school by field officers using performance descriptors. Judgements about pupils' abilities are necessarily subjective, and although the field officers were provided with some training to help improve the consistency of their assessments, their judgements were not subject to moderation and it can be expected that there would be differences between field officers.
The practical assessments were not designed to provide robust national estimates of the three skills investigated, because the numbers of pupils and field officers required to achieve this would be prohibitive and beyond the scope of the SSA. However, the results do represent useful, indicative information for teachers and educationalists for contrast and comparison with the evidence they gather through their own work with pupils. The practical assessments also provide exemplification of practical assessment methods as alternatives to traditional pencil and paper tests, and provide professional development opportunities for teachers.
Throughout the following section, findings are presented as sample statistics only; the results are not weighted to provide estimates for the population.
F.2 Working with others
Table F1 presents the assessments made of pupils' skills when working with others.
Table F1
Results of the assessment of the skills of working with others, by stage
(% pupils rated as indicated for various aspects by field officers)
| P3 | P5 | P7 | S2 |
|---|
New ideas |
|---|
Little or no contribution to discussion | 23 | 14 | 11 | 28 |
|---|
Contributes ideas & participates freely in the discussion | 59 | 67 | 69 | 52 |
|---|
Contributes most of the ideas | 18 | 19 | 20 | 20 |
|---|
Number of pupils assessed | 354 | 341 | 429 | 357 |
|---|
Building on others' ideas |
|---|
No evidence of listening to ideas of others and building on them | 15 | 7 | 4 | 11 |
|---|
Some evidence of listening to ideas of others and building on them | 49 | 46 | 33 | 46 |
|---|
Listens to others' ideas of others and, for most part, builds on them | 36 | 48 | 63 | 43 |
|---|
Number of pupils assessed | 352 | 334 | 423 | 343 |
|---|
Motivation |
|---|
Shows little or no interest in task, ignoring or disrupting others | 8 | 4 | 3 | 9 |
|---|
Addresses task and shows some interest in completing the task | 32 | 24 | 19 | 33 |
|---|
Shows engagement with the task and is motivated to complete the task | 60 | 72 | 79 | 58 |
|---|
Number of pupils assessed | 355 | 329 | 423 | 348 |
|---|
The discussion |
|---|
Takes turns | 66 | 65 | 69 | 63 |
|---|
Adopts clear role within group | 16 | 23 | 23 | 28 |
|---|
Dominates the discussion | 8 | 8 | 5 | 3 |
|---|
Adopts disruptive role or is disengaged | 10 | 4 | 4 | 6 |
|---|
Number of pupils assessed | 344 | 337 | 411 | 331 |
|---|
The results show that between 70-90% of the pupils assessed contributed ideas within their groups and around 85-95% showed at least some evidence of listening to the ideas of others and building on them. The proportion of pupils who made little contribution to the discussion or showed no evidence of listening to others was higher at P3 and S2 than P5 and P7.
Pupils were in general well motivated, with more than 90% showing at least some interest in completing the task and between 80-90% contributed to the discussion without dominating it or being disruptive.
F.3 Problem solving
Field officers rated entire pupil groups for various aspects of problem solving as they worked together to solve their given problem. The results are shown in Table F2 below.
Table F2
Results of the assessment of problem solving, by stage
(% groups rated as indicated by field officers)
Aspect | Stage | Number of groups assessed | No evidence | Some evidence | Strong evidence |
|---|
Understanding & exploring the problem |
|---|
- Explores different ways of tackling the problem | P3 | 98 | 24 | 57 | 18 |
|---|
P5 | 96 | 9 | 45 | 46 |
|---|
P7 | 116 | 8 | 39 | 53 |
|---|
S2 | 97 | 34 | 37 | 29 |
|---|
- Come to a consensus as to strategy, course of action | P3 | 98 | 19 | 57 | 23 |
|---|
P5 | 95 | 12 | 35 | 54 |
|---|
P7 | 117 | 3 | 29 | 68 |
|---|
S2 | 101 | 14 | 42 | 45 |
|---|
Resolving the problem |
|---|
- Critically reflects on the process or strategy, amending or adapting if necessary | P3 | 97 | 29 | 53 | 19 |
|---|
P5 | 93 | 16 | 39 | 45 |
|---|
P7 | 115 | 10 | 39 | 51 |
|---|
S2 | 97 | 25 | 42 | 33 |
|---|
- Agrees roles/responsibilities within the group. | P3 | 98 | 18 | 50 | 32 |
|---|
P5 | 96 | 11 | 47 | 42 |
|---|
P7 | 118 | 6 | 22 | 72 |
|---|
S2 | 101 | 11 | 42 | 48 |
|---|
Completing the task |
|---|
- Task successfully completed | P3 | 97 | 5 | 68 | 27 |
|---|
P5 | 94 | 2 | 34 | 64 |
|---|
P7 | 115 | 1 | 27 | 72 |
|---|
S2 | 98 | 2 | 36 | 62 |
|---|
At least 95% of the groups at each stage showed at least some evidence of completing their task successfully, although fewer of the P3 groups showed strong evidence of successful task completion than the other stages. For the other aspects, the P7 groups were assessed most positively, followed by the P5 groups.
F.4: Using ICT
Pupils were individually assessed for ICT skills and the summary results are shown in Table F3.
Table F3
Level attainment results for ICT skills, by stage
stage | Number of pupils assessed | (% pupils deemed by field officers to be at indicated levels) |
|---|
<A | A | B | C | D | E | F |
|---|
P3 | 431 | 4 | 53 | 39 | 4 | 0 | 0 | 0 |
|---|
P5 | 428 | 0 | 12 | 34 | 42 | 11 | 1 | 0 |
|---|
P7 | 479 | 0 | 2 | 6 | 23 | 45 | 19 | 5 |
|---|
S2 | 354 | 0 | 0 | 1 | 11 | 29 | 41 | 19 |
|---|
At P3 most pupils were judged by the field officer to be at level A or better in ICT. Over 40% were judged to be beyond level A. At P5 over 80% were judged to be at level B or better and over half were judged to be at C or better. At P7 almost 70% were judged to be at level D or better with around a quarter beyond level D. At S2, 60% were judged to be at E or better and almost one in five were judged to be at level F.
« Previous | Contents | Next »