« Previous | Contents | Next »
Listen
3. METHODOLOGY
Monitoring and Evaluation data
3.1 A range of sources are available that relate directly and indirectly to FTWiSS. Qualitative and quantitative research as well as basic monitoring information on the FTWiSS applicants has been collated and brought together for the first time in order to formulate an evaluation of the scheme.
3.2 Numerous pieces of research have been carried out and commissioned by the devolved government in Scotland in relation to the Fresh Talent Initiative as a whole and, where appropriate, findings relating to FTWiSS have been drawn out.
3.3 The quality and volume of the research available is weighted towards the processes involved in setting up and delivering FTWiSS and gaining a sense of its effectiveness in attracting people onto the scheme. Efforts have been made to try and track those on FTWiSS and gain some sense of outcomes, particularly as those who were first to apply are reaching the end of their 2 years, but this has not been systematic.
3.4 Further research is required if questions relating to the destinations and outcomes of the individuals on the scheme are to be fully understood and analysed in the long-term.
Data from FTWiSS application forms
3.5 Data on the name, address at time of application, date of birth, and nationality of all successful applicants has been collected by the Home Office since the introduction of the scheme in June 2005. By April 2008, 8181 individuals had been granted FTWiSS leave, 7268 in country and 913 at visa offices overseas.
FTWiSS Monitoring questionnaire
3.6 About 2 months after the start of their leave all successful FTWiSS applicants are contacted by letter by the Scottish Government's Relocation Advisory Service ( RAS) and asked to complete an online monitoring questionnaire about their experiences, perceptions and intentions as an FTWiSS applicant. It is not compulsory that individuals reply to the questionnaires or answer all the questions.
3.7 Monitoring questionnaire data is presented in three waves. Wave 1 covers the 705 responses received between June 2005 and September 2006. After this, the online version of the questionnaire was replaced with a word document on the website due to technical problems. New FTWiSS applicants continued to be sent letters directing them to the website to complete the questionnaire, where they we then asked to print out the word version of the questionnaire and return it by post. Unsurprisingly, given the effort required to do this, very few responses were received during the following seven months and these are not presented here.
3.8 In June 2007 the online questionnaire was made available again. Articles were placed on the Relocation Advisory Service website and in the monthly RAS e-newsletter, requesting everyone on the scheme to fill in the questionnaire, even if they had already done so in the past. As a result, 162 new responses and 14 questionnaires from people who had previously replied were received. Due to the small numbers, the follow-up responses were not analysed. The findings from the new responses are presented as wave 2.
3.9 In October 2007, a revised version of the questionnaire as well as a new follow-up questionnaire was placed on the website. The 201 responses received to date 20 are presented as wave 3. Fewer than 10 responses have been received for the follow up questionnaire and therefore findings are not included in this report.
3.10 The monitoring questionnaire mainly consists of quantitative questions, most of them precoded, about the respondents' personal characteristics, place of residence, education, employment and plans for the future, as well as their perceptions of Scotland.
3.11 The questionnaire also included a small qualitative element. Respondents were given the opportunity to comment on any issue relating to FTWiSS or Scotland at the end of the questionnaire. 424 written comments were received. In addition to this, respondents who felt that they were not in suitable employment were specifically prompted to comment in their own words on why they thought this was. 390 comments on this topic were received.
Borders and Immigration analysis of visa applications of FTWiSS
3.12 The Border and Immigration undertook analysis of FTWiSS statistics for applications made in country (both at Public Enquiry Offices and postal applications) between the introduction of the scheme in July 2005 and 31 st August 2005, looking at the proportion of people that had applied for other visa and whether they were resident in Scotland at the time of doing so.
Customer and Website User Surveys of Relocation Advisory Service
3.13 The Relocation Advisory Service ( RAS) is the operational arm of the Scottish Government's FTI. It was set up in October 2004, initially for a pilot period of 3 years, but was extended to the end of October 2008. Its main aim is to provide information and advice to people looking to relocate to Scotland and, up to February 2008, had dealt with some 18,000 customers.
3.14 RAS has been evaluated over 2 phases. The first evaluation, which was published in 2006, included an online survey with customers as well as qualitative interviews with customers and partners. 21 The second phase evaluation was published in May 2008 and has been used to inform this paper, eg the online survey of customers and qualitative interviews. The evaluation data includes important insights into the number and type of enquiries being made about FTWiSS. 22
Qualitative research with Individuals on FTWiSS for 2 years
3.15 In July 2007, twelve depth interviews with individuals coming towards the end of the FTWiSS leave or having completed their leave were conducted to investigate in detail individuals' personal experiences of being on FTWiSS. The research had the following objectives:
- To better understand the impacts of FTWiSS for the individuals coming to the end of the scheme
- To explore how individuals have used the 2 year FTWiSS "window" and their reflections on the scheme.
- To identify common themes and factors that individuals coming to the end of their FTWiSS feel have contributed to any changes in their life/circumstances over the period.
3.16 Eleven interview participants were recruited via letter from those that had completed the FTWiSS monitoring survey sent out to everyone joining the scheme and had agreed to take part in further research. Only those resident in Edinburgh at the time of completing the survey were contacted. In addition, one participant was recruited via another interviewee. Most interviews were conducted face to face in Scottish Government offices, and two were conducted by telephone. Interviews lasted between 35 minutes and 1 hour 30 minutes.
3.17 Interviewees came from a range of countries in North America, Africa, Eastern Europe, South Asia and South East Asia, had studied a variety of subjects at university and were employed in a range of industries. All had studied in Edinburgh and all but one had undertaken postgraduate study. Most participants lived in Edinburgh at the time of interview, while one had returned to their country of origin and one had moved to London.
3.18 With the participant's permission, interviews were tape recorded to facilitate analysis. Verbatim transcripts were produced and analysed using the analytical framework presented in Annex C while taking care to record issues not covered in the framework.
3.19 The findings reflect the range and diversity of views and experiences of people taking part in the study, but it is important to remember that this is qualitative research and is not designed to be statistically representative and that therefore the findings do not reflect the extent to which issues and experiences exist among people on FTWISS as a whole.
Research About Scotland in China and USA
3.20 Research undertaken to support the development and monitoring of Scotland's engagement with China and the USA included qualitative research that covered perceptions of Fresh Talent and, in particular, FTWiSS. Research components in China were: semi-structured interviews with university staff and overseas study agents and focus groups with final year students. In Scotland, interviews with Chinese students studying at Scottish universities and university staff responsible for overseas students were conducted. Research in the USA involved focus groups with students and semi-structured interviews with academics. 23
Experience of People Who Have Relocated to Scotland
3.21 This qualitative research was published in 2006 and looked to inform the development of the Fresh Talent Initiative by exploring why people choose to relocate to Scotland - including returning Scots, people from the rest of the UK and people from outwith the UK. Within that, it explored the factors that have helped people to relocate to Scotland, in particular support with accessing employment opportunities and settling into Scottish life, including understanding the positive experiences and/or barriers encountered. FTWiSS had only just been introduced when the fieldwork for this research was carried out, but it offers an important initial insight into the reactions and attitudes to the scheme. The research involved semi-structured interviews with: individuals from organisations in contact with in-migrants and with in-migrants in three sub-groups of entrepreneurs, employees and post graduates. It also involved follow-up focus groups with in-migrants. 24
« Previous | Contents | Next »