Part Two: Evaluating the Care and Welfare of Residential Pupils
back.gif (1426 bytes)

PART 2
GETTING STARTED:
self-evaluation using performance indicators


In this Part, you are given opportunities to build on the Broad View and Closer Look approaches to self-evaluation discussed in Part 1.

Of the 7 Key Areas and 33 PIs set out in 'How good is our school?', 4 Key Areas and 15 PIs are particularly relevant to CWRP. In Part 4, practical examples, featuring good practice, take forward the CWRP Key Areas and PIs Grid to help you answer the 'How do you know?' question.

How are we doing? Taking a Broad View
With the success of 'How good is our school?', taking the Broad View has become one of the favoured and most straightforward ways of getting started in school self-evaluation. It is also a way of involving staff at all levels. As pointed out in Part 1, all you need to do to get started is to scan across the 4 Key Areas and 15 PIs in the PI Grid, assigning one of the 4 levels to each indicator on the basis of professional judgement and make reference as necessary to the Features of Good Practice. In other words, take a Broad View based on what you know about your residence, how you feel about your residence, drawing on evidence you already have from formal and informal sources plus information and insights available only to the 'insider', the personal stakeholder. The Broad View provides you with an overview of how you are doing, identifying areas of strength or points for action or aspects which are in need of a Closer Look.

The ways in which you use the Broad View across all 4 Key Areas will vary according to, for example, the size and scale of the residential provision as a whole, including the number of pupils and houses/hostels, and staff experience of self-evaluation. The important thing is to get all staff involved as soon as possible and to foster an ethos of openness in the drive to improve CWRP.

In a small residence, you could discuss 'How are we doing?' using the PI Grid at a staff meeting. In a larger residence, you might divide into house/hostel groups or stage groups. In other circumstances, senior management might scan all 15 indicators while, for example, care staff choose a subset focusing on support for all pupils. You might decide, however, to take the Broad View by working together to look at the findings from different perspectives, for example, the staff as a whole, the senior staff, care staff, ancillary staff and staff by house/hostel.

Taking account of the views of pupils and parents
Self-evaluation is very much about taking account of the views of pupils and parents as well as staff, and you will wish to discuss the ways of finding out what these important stakeholders think about the school's performance in the Key Areas. The set of CWRP Questionnaires used by HMI in inspections provides a good starting point and can be used in both the Broad View and Closer Look to complement your use of the CWRP PI Grid. In the same way, many schools are making use of questionnaires and similar approaches in taking account of the views of pupils and parents in reviewing and evaluating the school development plan.

When taking a Broad View, for example, you might decide to use the pupil questionnaire to get an overall feel for what pupils think about life in the residence in general. In the Closer Look, for example, on pastoral care, you might decide to home in on the questions relating to pastoral care as a way of sampling the views of pupils, parents/guardians and residential staff. Your approach on sampling will vary according to, for example, the size and scope of residential provision, the Key Area under scrutiny, experience of self-evaluation and other sources of evidence.

Just as with the CWRP PI Grid, you will need to think carefully about how and when in taking account of the views of pupils and parents. Self-evaluation, in particular feedback, is accompanied by a degree of anxiety and can be a sensitive exercise (for further advice see 'Using ethos indicators in school self-evaluation' (SOED), available from the Scottish Schools Ethos Network, Moray House Institute of Education, Edinburgh EH8 8AQ). It needs to be preceded by questions such as:

  • what is the purpose?
  • who is it for?
  • who will carry it out?
  • who will be consulted?
  • how much time/energy will it consume?
  • how will the results be shared?

The more that evaluation is a residence enterprise in which everyone feels that they have some investment, the more likely the chance of success.

How are we doing? Taking a Closer Look
The next step is to take a Closer Look, using the findings gained in taking a Broad View. In your Broad View of CWRP, you assigned overall levels of performance to the various indicators. You also noted major weaknesses or areas requiring further development and now need to consider which of these you should look at more closely, for example, those:
  • in which performance seems to be at level 1 or 2
  • which relate to other current developments in the establishment
  • which relate to a national initiative
  • which have not been looked at closely for some time
  • in which performance is at level 3 or 4, but where there are relatively straightforward ways in which a significant difference could be made for pupils.

If there are several aspects which merit a Closer Look, then you will need to weigh up the relative importance of the above factors before coming to a decision. Remember, the approach must be manageable and might require you, for example, to focus on a particular residence, or on a particular group of pupils,or a high profile national initiative.

For example, let us assume that your Broad View has indicated that there is a need to take a Closer Look at pastoral care. The illustration following gives one way of setting out your findings (considerations). These considerations allow you to draw up a plan of action to improve pastoral care. The same approach can be used in other areas (a guide to taking a Closer Look is given in 'How good is our school?', pages 15 to 31).

Area(s) of CWRP at which we should take a Closer Look in our school
Area of CWRP Considerations
Pastoral Care
  • Our child protection procedures are stated in the residence handbook but they need to be described in clearer terms.
  • We need to develop a personal safety programme for pupils, which.....
  • We need to check pupils' personal electrical equipment more frequently, for example, at the beginning of each new term.
  • In their responses to questionnaires, pupils have indicated that staff are not consistent in their interpretation of the rules of the residence.
  • Some pupils need more assistance from staff in order to plan their work and recreation time more effectively.

What are we going to do now?
The next step is to take your considerations and evaluate pastoral care in a thorough manner using the Closer Look approach. In this case, for example, the PI is 4.1: Pastoral Care; the theme is provision for the emotional, physical and social needs of individual pupils. Part 4 will allow you to locate the PI and theme.

To help you to make a rigorous evaluation such as a Closer Look, you will have to consider evidence. Sources of evidence could include:

  • views from individual pupils, parents and teaching and care staff
  • structured discussions with groups of pupils
  • discussions with the Board of Governors and/or local authority managers and officials
  • CWRP Questionnaires to pupils, parents and care staff
  • comparison of practice against checklists
  • observation, analysis (for example, of pupil interviews) and sharing of findings
  • reports, records and logs kept by staff
  • surveys of policy implementation

You will then be in a position to assign an overall level of performance 1-4, against each feature of good practice listed in the practical examples in Part 4:

Level 4 very good almost all aspects of the good practice exist
Level 3 good most aspects of the good practice exist
Level 2 fair some aspects of the good practice exist
Level 1 unsatisfactory few aspects of the good practice exist
You now have to:
  • sum up your evaluations
  • list strengths, for example, formal procedures are followed and informal opportunities taken for staff to share information and concerns about pupils
  • list weaknesses, areas for development and resulting targets, for example, safety and emergency procedures are not well defined
  • target: by end of....., to define clearly safety and emergency procedures, to ensure that all staff and pupils are aware of these and carry them out consistently, as shown by staff observation, and set evaluation clearly.

Your identified strengths, weaknesses, areas for development and resulting targets should be recorded carefully. Targets should be implemented immediately where necessary (as in the case above), or considered for inclusion in the development plan.

Annually, you may wish to review overall provision using the Broad View approach. However, all Key Areas of your overall CWRP provision should be evaluated (Closer Look) in turn within a regular cycle of review and development, for example, a three-year cycle within an annual development plan.

Back to Top