****
Scottish Executive*Consultations  

Making it work together
* * *
* Home | Topics | About | News | Publications | Consultations | Search | Links | Contacts | Help *
*
 

< Previous | Contents | Next >

EFFECTIVE AND COST-EFFECTIVE MEASURES TO REDUCE ALCOHOL MISUSE IN SCOTLAND: A LITERATURE REVIEW

CHAPTER FIVE ENFORCEMENT

Summary

This chapter reviews the effectiveness and cost-effectiveness evidence relating to interventions to enforce legislation. The main findings are:

  • there is limited evidence supporting community enforcement programmes for under-age drinking in the US;
  • random breath testing has been effective in enforcing drink drive legislation in the US and Australia, reducing fatalities, injuries and crashes;
  • a study modelling the costs and benefits of a sobriety checkpoint, using US data, showed benefits in excess of costs; and
  • a study of a server training programme in the US also found benefits in excess of costs.
  • Results based on US cost data cannot be directly translated to a UK setting. There is a lack of UK data relating to enforcement actions.

Introduction

5.1 The previous chapter included evidence relating to legislative interventions. The impact of legislation also depends on the action taken to enforce the measures and the visibility of the enforcement process. This chapter covers evidence relating to specific enforcement actions in the areas of:

  • legal drinking age; and
  • drink driving.

The studies reviewed are summarised briefly in tables 5.2 (effectiveness) and 5.3 (cost-effectiveness) at the end of the chapter.

Legal drinking age

Types of intervention

5.2 Enforcement of under-age sales laws frequently takes the form of ‘decoy sales’, in which under-age buyers attempt to purchase alcohol under observation of the enforcement agency. Enforcement campaigns may be accompanied by media publicity and training schemes aimed at sales outlets.

Effectiveness

5.3 Communities Mobilizing for Change on Alcohol was an initiative in which communities were encouraged to develop their own specific interventions to reduce under-age access to alcohol (NIAAA 2000). Interventions, which varied across communities, included activities to enforce restrictions on sales of alcohol to minors. After 2 1/2 years, age checks at outlets were more frequent and the likelihood of sales to minors reduced.

5.4 The Community Trials Project had 5 interacting components aimed at reducing alcohol related injuries and deaths. Results were mixed; for example, voluntary server training was not effective at the community level but outlets in intervention sites were half as likely to sell alcohol to an apparent minor.

Quality and relevance of evidence

5.5 Only a small number of studies have been carried out and the results may be specific to the communities in which they were developed. Multi-agency interventions in the UK have not been effectively evaluated.

Driving related

Types of intervention

5.5 A range of interventions has been employed to enforce legislation relating to drinking and driving. The main initiatives that have been subject to evaluation are:

ignition interlock devices. These require the driver to provide a breath sample before starting a vehicle. If the sample corresponds to a blood alcohol content above a pre-specified level the ignition is locked, preventing the vehicle being driven;

‘administrative per se’ licence suspension. This allows for the immediate suspension of a driving licence subsequent to failing a sobriety test and without requiring conviction through the judicial system; and

random alcohol screening. This involves stopping vehicles without prior suspicion of alcohol use. In Australia, all drivers stopped have a breath test administered whereas in the US breath tests are administered only if the use of alcohol is suspected after the driver has been stopped. Random alcohol screening works through both deterrence and detection.

Sanctions against convicted drink drivers may include a range of interventions combining license penalties and treatment (Wells-Parker et al 1995).

Effectiveness

5.6 There is some evidence that ignition interlock devices may be effective in preventing re-offending during the time they are installed (Coben and Larkin 1999). Although there are some design problems with the studies, the findings are confirmed by the one RCT in this area. The relative risk of re-offending was 0.36 for the interlock group (95% CI; 0.20,0.61).

5.7 The evidence relating to the effectiveness of administrative per se licence suspension is mixed (McArthur and Kraus 1999). The intervention was effective in 3 states for at least one year after initial licence suspension but did not work in two other states.

5.8 There is evidence to support the effectiveness of random alcohol screening (Peek-Asa 1999). All studies except one showed reductions in fatalities, injuries and crashes and the exception could also be reanalysed to show a decrease. Decreases in alcohol related fatalities and injuries were greater than total decreases. The results were generally the same for studies that measured alcohol use directly and those that used proxy measures. Decreases were generally greater in Australia than in the US. (One excluded study from Sweden did not find a significant decrease).

Table 5.1 Range of reductions in traffic fatalities, injuries and crashes.

 

Total decrease

Alcohol related decrease

Fatalities

16% to 29%

17% to 75%
Highest figure is from study in 2 small communities

Injuries or crashes

10% to 28%

0% to 32%

Source: Peek-Asa 1999

Intensity of intervention.

5.9 With respect to random alcohol screening, two studies examined the effects of the level of enforcement. One found greater reductions with increased enforcement and one found no effect.

Quality and relevance of evidence

5.10 For evaluations of ignition interlock devices, there was only one RCT and the randomisation process was inadequately described. All studies relied on re-arrest rates as outcome measures and this is a relatively rare event. There was potential for allocation of lower risk offenders to ignition interlock programmes in non-randomised studies. There was a lack of description of other components of repeat offender programmes or other sanctions applied.

5.11 The evaluations of administrative per se licence suspension included no randomised or non-randomised controlled trials. Results are based on studies comparing events before and after introduction of laws. Whilst this may be an appropriate study design, it can be difficult to attribute effects to the intervention, particularly when other initiatives may be taken at the same time.

5.12 The evaluation of random alcohol screening also relies on before and after study designs. Studies generally had short follow up periods and lacked direct measures of the number of impaired drivers involved in crashes. Proxy measures used included single vehicle night-time crashes. There was a lack of multivariate analysis to control for other deterrence programs, resulting in a problem of attribution of effects as above.

5.13 A review of the methodology relating to drink driving studies found that most studies had design flaws (Wagenaar et al 1995). In addition, there was insufficient reporting of data for purposes of meta-analysis and most studies had relatively short follow up periods.

Cost-effectiveness

Alcohol server laws

5.14 Levy and Miller (1995) undertook a cost-benefit analysis to investigate a pilot scheme to forbid the serving of intoxicated drinkers. The analysis is based on a case study in Washtenaw, Michigan, of a server intervention programme (SIP). Data on the incidence of adverse events were taken from police files from before and after the programme enforcing alcohol server laws. Costs of alcohol related adverse consequences were scaled down to represent the Washtenaw County population. The population for the analysis was patrons drinking at controlled establishments and the outcomes of interest were fatal and non-fatal injuries as a consequence of drinking. Programme costs were based on local police costs ($48,400) and publicising the programme and training costs ($3,000). The total benefits of the scheme were derived from the total US costs as a result of alcohol-related accidents and medical care. Medical cost savings were an estimated $0.47 million, monetary benefits $3.7 million and total comprehensive cost savings were $10.1 million.

5.15 Levy and Miller present benefits of the programme as much greater than costs. Applying before and after data for the SIP programme and then calculating the change in costs provides a significant positive cost saving to society. However, it is very difficult to see exactly how the figures were calculated and other assumptions may yield different results, e.g. alternative sources of alcohol rather than exclusively licensed premises. The policy relevance is limited outside the study area, as costs of incidents are very different, as are licensing laws.

Community sobriety checkpoint

5.16 Miller et al (1998) investigated the costs and benefits of a community sobriety checkpoint program to reduce the incidence of drink driving and associated accidents in the USA. The analysis was constructed using a hypothetical population of 100,000 licensed drivers. Benefits were estimated using data from 1993 alcohol-involved crash incidence. Costs per crash were taken from published studies. Various estimates of the reduction in accidents were used to estimate the benefits, with estimates taken from previously published studies documenting crash reductions following similar programmes. Miller et al used estimates of 5%, 10%, 15% and 20% reductions, and a rate of 250 driver stops per 4 hour checkpoint.

5.17 The study was based on a hypothetical community of 100,000 drivers, with outcomes based on averted fatalities, averted non-fatal injuries and averted property damage. The costs of the programme were police wages, checkpoint equipment (trailer and generator, breath test equipment), and a mobile video system at a total cost of $39,000 (£26,500 1990 prices). The best estimate pointed to a reduction in alcohol related crashes by 15%. Benefits of the programme included $7.9 million savings in alcohol-related crashes and $0.3 million in averted property damage. Annual operating costs were $1,181,000. Other costs were travel delays ($44,000) and criminal justice costs ($172,000). Each of 156 checkpoints cost society $7570, imposed $2175 in costs to drivers and yielded $50,000 benefits. Every $1 invested in the programme saved society an estimated $6.

Further research

5.18 There is a lack of UK evidence relating to enforcement actions. Random testing for drink drivers emerges as the intervention most likely to have an effect but studies are needed to address the questions of how long the effects of enforcement actions are sustained and the level of enforcement that is optimal, in terms of costs and benefits. UK studies of enforcement actions relating to under-age drinking are required.

Table 5.2 Summary of Enforcement Effectiveness Studies Reviewed

Author(s) and Date

Search Strategy

Inclusion / Exclusion Criteria

Quality assessed

Number of studies

Target Group

Main Findings

Coben J, Larkin G. Effectiveness of ignition interlock devices in reducing drunk driving recidivism. American Journal of Preventative Medicine 1999; 16(1S): 81-7.

Yes.

Studies were included if they were randomised-controlled trials, controlled trials, case-control studies, cohort studies or ecological studies. Studies were required to have a clear description of the program and outcomes evaluated, to have a comparison group and to provide interpretable and original data.

Not reported

6 studies reviewed from an initial set of 31

Drivers with at least one prior conviction for driving while intoxicated.

Five of the 6 studies found programs utilising ignition interlocks were effective in reducing driving while intoxicated recidivism. Three of these studies had non-randomised groups and one was a retrospective study. In these 5 studies, participants in the interlock programs were 15%-69% less likely than controls to be re-arrested for DWI. Alcohol ignition interlock programs appear to be effective in reducing DWI recidivism during the time period when the interlock is installed in the car. Future studies should attempt to control for exposure (i.e. the number of miles driven) and determine if certain subgroups are most benefited by interlock programs.

McArthur DL, Kraus J. The specific deterrence of administrative per se laws in reducing drunk driving recidivism. American Journal of Preventative Medicine 1999; 16(1S): 68-75.

Yes. The search strategy is described in detail in a separate article, Rivara et al 1999

Studies included had a defined cohort of drivers with driving records available after mandatory licence suspension, a comparison cohort not subject to licence suspension, and relevant and interpretable data that lead to an objective assessment of recidivism.

Not reported

3 cohort studies

Drivers.

Administrative per se laws, governing licence restriction for drivers, have been shown to be effective in some states but not others in decreasing the rates at which these same drivers are subsequently involved in a motor vehicle crash or in another alcohol-related offence, compared with drivers who were sanctioned through other conventional judicial processes. Replications are needed in other states or large driver populations using improved methodology

National Institute on Alcohol Abuse and Alcoholism, 10th Special Report to the US Congress on Alcohol and Health June 2000

         

Reports on measures to enforce suspension of repeat offenders through vehicle tagging or immobilization and impounding of vehicles. The evidence for the former is unclear and the latter is reported to be effective. Ignition interlock devices are effective while fitted.
Sobriety checkpoints and random breath testing deter drunk driving.
Interventions to reduce under-age drinking , as part of community prevention strategies, have had some effect.

Peek-Asa C. The effect of random alcohol screening in reducing motor vehicle crash injuries. American Journal of Preventative Medicine 1999; 16(1S): 57-67.

Yes

Studies included evaluated a random screening program, included an objectively measured outcome, and had a control group and/or comparison period. Studies were excluded if they examined a number of prevention measures simultaneously and did not present results for random screening specifically and if they measured changes in drinking drivers without regard to crashes.

Yes

14 studies from US and Australia met the inclusion criteria

Drivers

Random screening appears to be effective in a wide range of both US and Australian populations. Despite the many limitations in the studies reviewed, the weight of evidence indicates that random screening reduces fatalities and injuries. There was some disagreement among studies as to how long the effects of random alcohol screening can be sustained and the level of enforcement necessary, and these remain questions to be answered.

Raistrick D Hodgson R Ritson B Tackling Alcohol Together. The Evidence Base for UK Alcohol Policy. 1999 Free Association Books London

         

High profile policing of licensed premises is associated with a reduction in arrests and rates of crime. Multi-agency interventions in the UK have not been effectively evaluated.

Wagenaar AC, Zobeck TS, Williams GD, Hingson R. Methods used in studies of drink-drive control efforts: A meta-analysis of the literature from 1960 to 1991. Accident Analysis & Prevention 1995; 27(3): 307-316.

Yes

Studies included had a comparison group, or a matched control, and had used an appropriate outcome measure. Excluded studies were individual site reports from the US Alcohol Safety Action Project (ASAP) of the early 1970s, or studies that were duplicate reports of a single underlying study. Nine studies were excluded as they used a significantly different research design from all the other studies

Yes

125

Not reported.

This review covered both legislation and enforcement. In the US, the most research attention has been paid to mandatory jail sentence policies and selective enforcement patrols. Internationally, illegal per se policies and sobriety check-points have received the most attention. The DWI control literature is limited by the preponderance of weak study designs and reports that often fail to include basic data required for meta-analysis. For US studies, journal articles were more likely to report positive effects than unpublished reports, consistent with publication bias. International studies had similar results for both journal articles and unpublished reports. Studies with comparison groups reported smaller effects than before and after designs. US studies using descriptive statistics only were likely to report larger effect sizes but this was not found in the international literature. It was found that the longer the follow-up the smaller the estimated intervention effect. Because policy makers and others often need timely information regarding effects of DWI control effects, short-term follow-up studies are not necessarily to be discouraged. However, longer-term follow-up studies beyond one or two years are particularly needed if there is to be lasting progress in reducing DWI and the damage it causes.

Wells-Parker E, Bangert-Drowns R, McMillen R, Williams M. Final results from a meta-analysis of remedial interventions with drink/drive offenders. Addiction 1995; 90(7): 907-26.

Yes

Studies included had samples which included DUI offenders and had to compare remediation to no remediation or to compare two or more forms of remediation.

Yes

194 studies

Drink drive offenders

The meta-analysis established that DUI remediation generally has a positive effect on alcohol-related traffic events — an effect of at least a 7-9% reduction in DUI recidivism and alcohol crashes. Remediation did have positive effects on alcohol related outcomes. Within the range of interventions that have been evaluated, the combination of remediation with licensing action appears most likely to affect positively both alcohol-related traffic events and more general traffic safety outcomes. Recidivism analyses suggested that some combinations of modalities, in particular those including education, psychotherapy/counselling and some follow-up, such as contact probation, showed larger effect sizes then other modes, while simple contact probation tended, in direct within-study comparisons, to be less effective than education or combination modes. However, the social and policy significance of any particular intervention effect, regardless of its magnitude, must be determined in the broader arena of personal and social values

< Previous | Contents | Next >

* * *
* Home | Topics | About | News | Publications | Consultations | Search | Links | Contacts | Help *
Crown Copyright | Privacy policy | Content Disclaimer | General enquiries