Spain

Country of origin
Spain
Last reviewed:
Age group
0-5 years
Target group
Elementary School children
Programme setting(s)
School
Level(s) of intervention
Universal prevention

The 1, 2, 3, Emoció! intervention is a school-based emotional education program designed by the Public Health Agency of Barcelona that aims to promote health and prevent future risk behaviours by enhancing emotional competencies in children aged 3 to 5 years old. It is an adaptation of the Social and Emotional Aspects of Learning program, developed in the United Kingdom. The 1, 2, 3, Emoció! programme works on the five emotional competencies described by Bisquerra et al. in 2003: emotional conscience, emotional regulation, emotional autonomy, social competency and life skills and well-being.

Keywords
prevention
Contact details
Servei de Salut Comunitària
Agència de Salut Pública de Barcelona
Pl. Lesseps, 1
Telèfon: 93 292 14 15
Email: prevencio.escola[at]aspb.cat
Evidence rating
Possibly beneficial
Studies overview

Pericas and colleagues (2022) evaluated this intervention in a stratified RCT using a sample of 2625 in a total of 37 schools in Barcelona (Intervention Group: 1291, 17 schools; Control Group: 1334, 20 schools). The researchers used a linear multilevel regression model with repeated measures (beginning and end of school year). Individual student scores on emotional competence were nested at school-level that in turn were stratified by type of school and neighbourhood socio-economic status. The newly designed Emotional Competence Assessment Questionnaire (ECAQ) was validated (Bartroli et al. 2022) and used to register (teacher registration) the level of emotional competencies of each child.

In boys, the mean change in the scores for Preschool year 3 (P3) was 24.51 points for those in the Intervention Group and 13.77 for those in the Control Group. In girls, the mean change in the scores for P3 was 24.40 points for those in the Intervention Group and 13.83 for those in the Control Group. Generally, a negative gradient was observed, as the change became smaller as the school year became higher, suggesting that the intervention may be more effective in the first year of pre-school.

San Pio and colleagues (2023) analysed the outcomes with nested linear regression models in a sample of 1586 children in 35 Barcelona schools. Considering sociodemographic variables and implementation outcomes, they compared 3 groups in the same data: 1) participated in 1, 2, 3, Emoció! during the three years of preschool: P3, P4, and P5, (= Complete Programme: CP); 2) participated in the programme for only one year (P5, Partial Programme - PP); and 3) did not participate in the programme (Comparison - C). The measured emotional competence level increased significantly after one year (4.1 in boys; 5.6 in girls; P < 0.05) and after three years of intervention (5.5 in boys; 8.0 in girls; P < 0.01), compared to comparison group. The level of emotional competence was the highest for the 3-year intervention group: obtaining an average ECAQ score of 131.1 (95% CI 126.9e135.2) for boys and 141 (95% CI 137.2-144.9) for girls. Completing the programme with high fidelity increased the level of emotional competence at the end of the school year by 20.5 points (95%CI: 15.9-25) for boys and 24.3 points (95%CI: 18.7-29.9) for girls, in comparison to 4.6 (95% CI: 1.5e7.7) and 5.9 (95% CI: 3.1-8.7) points for boys and girls, respectively, who receive the programme with low fidelity.

References of studies

Bartroli M, Juarez O, Ramos P, Puertolas B, Teixido Compaño E, Clotas C, et al. Programa d'educacio emocional per a segon cicle d'educacio infantil. Agencia Salut Pública Barcelona; 2018.

Bartroli, M., Angulo-Brunet, A., Bosque-Prous, M., Clotas, C., & Espelt, A. (2022). The Emotional Competence Assessment Questionnaire (ECAQ) for Children Aged from 3 to 5 Years: Validity and Reliability Evidence. Education Sciences, 12(7). https://doi.org/10.3390/educsci12070489

Bisquerra Alzina Rafael. Educacion Emocional y Competencias Basicas Para La Vida. Rev Investig Educ 2003;21:7e47.

Durlak JA, Weissberg RP, Dymnicki AB, Taylor RD, Schellinger KB. The impact of enhancing students' social and emotional learning: a meta-analysis of schoolbased universal interventions. Child Dev [Internet] 2011 Jan 1;82(1):405e32

Jones DE, Greenberg M, Crowley M. Early social-emotional functioning and public health: the relationship between kindergarten social competence and  future wellness. Am J Publ Health j Social Issues [Internet] 2015;105(11):2283. Available from: www.ajph.org.

Humphrey N, Kalambouka A, Bolton J, Lendrum A, Wigelsworth M, Lennie C, et al. Primary social and emotional aspects of learning (Seal). 2008 (November).

San Pío, M. J., Clotas, C., Espelt, A., López, M. J., Bosque-Prous, M., Juárez, O., & Bartroli, M. (2023). Effectiveness of a preschool emotional education programme administered over 3 grades: a cluster randomised controlled trial. Public Health, 218, 53-59.

Countries where evaluated
Spain
Protective factor(s) addressed
Individual and peers: skills for social interaction
Individual and peers: prosocial behaviour
Individual and peers: positive self-concept and self-efficacy
Risk factor(s) addressed
Individual and peers: impulsiveness
Outcomes targeted
Emotion regulation, coping, resilience
Description of programme

Promoting emotional competence or Socio-Emotional Learning (SEL) has shown to improve the emotional well-being of children and young adults and prevent mental health issues and high-risk behaviours. Studies found positive effects when socio-emotional skills and attitudes are further developed at young age: emotional well-being increased, academic skills, and social relationships improved and emotional stress, substance use, police arrests, risky sexual behaviour, and presence of psychiatric symptomatology decreased (individual studies can be consulted in San Pio, 2023). Preschool age from 3 to 5 years is postulated as an ideal time to initiate the development of emotional competence.

The five emotional competencies are addressed cross-sectionally through six thematic units: 1) belonging, 2) self-esteem, 3) friendship, 4) challenges, 5) justice and harassment and 6) changes, loss and death. The program includes 48 classroom activities, six family activities and 12 activities to be done in the school environment outside the classroom for each school year. The program is implemented by teachers throughout the school year, after completion of a specific 20-hour course.

Implementation Experiences
Feedback date
Country of origin
Spain
Last reviewed:
Age group
6-10 years
Target group
Children 5-10 years and their parents
Programme setting(s)
School
Level(s) of intervention
Indicated prevention

Empecemos is a multi-component programme, addressing the child itself, its parents and its teachers with the aim of reducing the further development of behavioural problems. It addresses the reciprocal, influential links between family problems, rejection by peers, maladjustment at school, and limited self-control and emotional processing skills, which usually generate a snowball effect, by which the opportunities for healthy development are increasingly reduced. Without proper intervention, conduct disorders become more chronic, and a maladjusted lifestyle becomes increasingly consolidated, resulting in problem substance use, together with antisocial, impulsive and emotional disorders.

Empecemos has been implemented in Galicia (northern Spain) and is ready to be implemented elsewhere. 

Contact details

Estrella Romero.
Facultad de Psicología, Santiago de Compostela.
E.mail: estrella.romero[a]usc.es

Evidence rating
Additional studies recommended
Studies overview

In the Romero et al 2017 study, a screening process identified children with significant conduct problems both at home with their family and at school, and the programme was implemented in eight schools. It included a long-term follow-up of 56 children for seven years. Multivariate analysis showed significant differences in attitudes (higher in the control group) and in the intention of using tobacco or alcohol (also higher in the control group). When the proportion of adolescents that will “probably yes” use tobacco was analysed, 11% of the intervention group was willing to use, compared with 42% of the control group (chi-squared: 7.59, 1 df, p < .001). As to adolescents that will “probably yes” use alcohol, 11% of the intervention group chose this response,compared with 35% of the control group (chi-squared: 6.23, 1 df, p < .01). No differences were found in age at onset. There were significant differences in the frequency of actual tobacco usel, but no significant differences in relation to aggressive conduct, despite the fact that facing rage is one of the most emphasised contents of the component for children. Also no significant differences were found in emotional control skills or in empathy, which seems to suggest that the specific effects on interpersonal emotions are attenuated over time and, therefore, that these components require reinforcements during the intervention. No significant effects were found in cannabis use; probably due to its later onset than tobacco and alcohol use.

The Romero et al. 2019 study assessed the efficacy of Empecemos in 128 children with behavioural problems in 18 public schools in urban and semi-urban areas: 67 in the intervention condition and 59 controls. There was random allocation to IG or CG at school level: 9 schools each. The tutors of the children enrolled them in the third to fifth years of primary education completing a brief screening instrument (10 items). Inclusion criteria were higher score at a T of 70 in the “Externalizing” dimension of this instrument. The data suggest that Empecemos improves emotional, cognitive and social skills, and reduces conduct problems, especially teacher-reported conduct problems. The study did not assess substance use related outcomes but showed significant effects when comparing the evolution of the intervention group versus the control group in other relevant behavioural outcomes. 

The limited sample size (common  in  these  types  of  studies  with  high-risk  children) weakens the statistical strength of both analyses carried out. Key issues for the rating: The studies all focus on different components and target groups. Only one study is a RCT with less than 12 month follow-up (post-test after 1 month) that only examined child outcomes, plus the IG had significantly higher age compared to CG (Romero et al., 2019). 

References of studies

Romero, E., Rodríguez, C., Villar, P. & GómezFraguela, X.A. (2017). Intervention on early-onset conduct problems as indicated prevention for substance use: A seven-year follow up. Adicciones, 29(3), 150-162. doi: 10.20882/adicciones.722.

Romero, E., Gómez-Fraguela, X.A., Villar, P., Rodríguez, C. (2019). Prevención indicada de los problemas de conducta: Entrenamiento de habilidades socioemocionales en el contexto escolar. Revista de Psicología Clínica con Niños y Adolescentes. Vol. 6 nº. 3- Agosto 2019 - pp 1-9

 

Countries where evaluated
Spain
Protective factor(s) addressed
Family: attachment to and support from parents
Family: opportunities/rewards for prosocial involvement with parents
Family: positive family management
Individual and peers: skills for social interaction
Individual and peers: prosocial behaviour
Individual and peers: coping skills
School and work: opportunities for prosocial involvement in education
School and work: rewards and disincentives in school
Risk factor(s) addressed
Family: family conflict
Family: family management problems
Individual and peers: anti-social behaviour
Individual and peers: favourable attitudes towards anti-social behaviour
Individual and peers: sensation-seeking
School and work: low commitment/attachment to school/workplace
Outcomes targeted
Emotional well-being
Emotion regulation, coping, resilience
Other mental health outcomes
Positive relationships
Relations with parents
Relations with peers
Other relationships (community, school)
Substance-related behaviours
Bullying
Social behaviour (including conduct problems)
Description of programme

This multi-component programme is based on the principles of social learning and is inspired by empirically validated programmes, such as Coping Power and Incredible Years. The use of audiovisual material facilitates modelling and the transmission of content as a more direct and flexible means than didactic instruction, written schemes or mere discussion. The objectives of Empecemos are to change parents’ educational practices, encouraging effective behaviour monitoring, positive educational practices and proper context structuring. It also aims to improve the quantity and quality of positive interactions between parents and children by reversing the cycle of coercion, through the promotion of shared activities and time together. Parents are trained to enhance positive behaviours, through the use of praise and incentives for positive behaviour. This provides parents with resources to deal with problem behaviours, through the establishment of limits that are appropriate to age and development of the child, in addition to the imposition of mild and non-violent sanctions for misconduct. Beyond this, the programme strives to strengthen family-school ties, by promoting participation in school activities and encouraging constructive interviews with the teachers. Empecemos consists of 19 sessions applied in the school context, which train children in recognition and emotional regulation skills. Empecemos incorporates, as one of its three components, a direct intervention module on children (emotional, cognitive and social skills necessary to display a socially competent behaviour style). Although Empecemos was conceived of as a joint and coordinated intervention programme for families, teachers and children, its implementation showed that the intensive and simultaneous involvement of these three agents is not always possible. Work overload, difficulties in combining schedules due to family responsibilities, situations of personal stress, or scepticism regarding the effectiveness of interventions often make it difficult to participate in interventions aimed at families and teachers.

Country of origin
Spain
Last reviewed:
Age group
11-14 years
15-18/19 years
Target group
Children/young people (12 to 17 years)
Programme setting(s)
School

Tú Decides: It´s Up To You aims to enable teenagers to make informed and responsible decisions regarding the use of drugs in relation to the other problems typically affecting this age group. It seeks to support students in the anticipation of realistic choice situations. It also targets problematic use of the internet and social networks. It is based on social influences, taking into account the peer group influences (peer pressure) and the affective and cognitive factors that intervene at the time of decision-making and problem-resolution.

Contact details

Amador Calafat
Email: calafatfar[a]gmail.com
Email: calafat[a]irefrea.org

Miguel Amengual
Equip de Promocio de la Salut. Servei d'Accio Social i Sanitat. [Health Promotion Team. Health and Social Action Service]. Majorca Island Council.
Street address: Calle General Riera, 67
Postal code: 07010
City: Palma de Mallorca
Country: Spain
Phone: +34 971 761121
Fax: +34 971 761746
Email: mamengual[a]cim.net

Evidence rating
Additional studies recommended
Studies overview

The programme has been evaluated in three studies in Spain: (i) a quasi-experimental study (1984) in Mallorca conducted in 15 schools among 261 students, four months after the programme ended; (ii) an RCT (1988) in Baja, conducted in 12 schools among 376 students, 12 months after completing of the programme; and (iii) a quasi-experimental study (doctoral thesis, 1985) in San Just Desvern and Viladecans, conducted in two schools with randomly selected classes, among a small sample (n= 84 students in both groups), with the post-test conducted four months, one year, and two years after completing the programme.

The first study (QED) found that the intervention group’s consumption was below the mean of the control group. There was significant reduction in getting drunk. There were significant increases in knowledge about the types of drugs (higher in the intervention group than the control group), and about the consequences of substance abuse. Attitudes towards future drug use were descriptively analysed, the questionnaire was not sufficiently aimed at measuring comprehension of external influences on use. There was an increase in acceptance of social and institutional control mechanisms related to substance use, reduction in getting drunk during the last six months, and reduction in money spent in alcohol. The results indicated that high-risk students were not/less affected by the intervention.

The second study (RCT) found that the control group significantly increased alcohol and tobacco use, and the intervention group remained at the same level. There was an increase in more rational reaction to drugs, less aggressive reaction towards measures of control (law or adults) among intervention group. There were less favourable attitudes toward drugs among intervention group, however there was no effect on decision-making. Similarly the high-risk group was less/not affected by the intervention. Only non-consumers maintained their non-use attitude while users did not reduce their use (the control group participants did increase their use).

The last study (doctoral thesis/QED) found that the intervention group showed big preoccupation with the health risks before use and this seemed to influence actual use. Smoking decreased in post-test but increased in follow-up one year after. There was no significant decrease in drug use in the intervention group, but there was an increase in the control group (the programme had an influence). At 4 months there was a decrease in alcohol consumption, decrease in smoking and weekend smokers, but not the daily smokers. Two years after, there is a slight increase in new drinkers in intervention group, but significant increase in control group. There were no iatrogenic effects.

References of studies

Outcome evaluations:

Calafat, A.; Amengual, M.; Farres, C. y Monserrat, M. (1984). Eficacia de un programa de prevención sobre drogas, especialmente centrado en la toma de decisiones, según sea desarrollado por especialistas o por profesores de los alumnos". Drogalcohol. IX, 3,. 147-169.

Calafat, A.; Amengual, M.; Mejias, G.; Borras, M. y Palmer, A. (1989). Evaluación del programa de prevención escolar 'Tú decides'". Adicciones. 1,2, 96‑111.

De la Rosa, A. (1995). La prevención de las drogodependencias en el ámbito escolar. Una experiencia práctica evaluada. Tesis doctoral. Universidad de Barcelona.

 

Concept papers/Other:

Amengual, M. y Calafat, A. (1997). Un modelo evaluado de prevención escolar. El programa ‘Tú decides’”. Revista de Estudios de Juventud, 40, 111-126.

Calafat, A.; Amengual, M.; Farres, C. y Monserrat, M. (1982b). Tú decides. Programa de investigación y educación sobre el uso de drogas. Palma de Mallorca: Comissió de Sanitat. Consell Insular de Mallorca.

Calafat, A.; Amengual, M.; Farres, C. y Borras, M. (1985a). Tú decides. Programa de educación sobre drogas. Palma de Mallorca: Servei d'Informació i Prevenció de l'Abús de Drogues. Comissió de Sanitat. Consell Insular de Mallorca.

Calafat, A.; Amengual, M.; Guimerans, C.; Rodriguez-Martos, A. y Ruiz, R. (1995). Tú decides: 10 años de un programa de prevención escolar. Adicciones, 7, 509-526.

Exchange on Drug Demand Reduction Action (EDDRA), EMCDDA. Tú decides: It´s Up To You. A Spanish Educational Drugs Programme. Summary.

Kornblit, A. L., Mendes, A. M. y Bilyk, A. (1990). “’Vos decidis’: un programa de prevención de consumo de drogas en la escuela media”. Medicina y Sociedad, 13, 5-6, 36-40.

Maciá, D., Olivares, J. y Méndez, F. X. (1993).Intervención comportamental-educativa en la prevención de la drogodependencia. En Méndez, F. X., Maciá, D. y Olivares, J. “Intervención conductual en contextos comunitarios I. Programas aplicados de prevención. Madrid: Editorial Pirámide.

Rodríguez-Martos, A.; Torralba, LL. y Vecino, C. (1996). Decideix! Programa de prevención del abuso de drogas en enseñanza secundaria: la experiencia de Barcelona. Adicciones, 8, 127-148.

 

Countries where evaluated
Spain
Protective factor(s) addressed
Individual and peers: clear morals and standards of behaviour
Risk factor(s) addressed
Individual and peers: peers alcohol/drug use
Outcomes targeted
Other educational outcomes
Substance use
Alcohol use
Use of illicit drugs
Smoking (tobacco)
Description of programme

Tú Decides programme is a school-based dependency prevention program that targets youth aged between 12 and 17 years, the critical age for drug initiation and drug use. It is based on social influences, taking into account peer pressure and the affective and cognitive factors intervening at the time of decision-making. It consists of three manuals (teachers, students and parents) that contain all the information necessary for its application. The manuals approach the themes through comics and various activities.

The programme is provided by trained teachers to students in two-hour sessions, one per each unit (8 hours in total), over the course of four months. The programme consists of 6 modules: (1) What about drugs? (2) A way to start. (3) Ana has fun. (4) What do you connect to (about the use of the internet and social networks)? (5) Two versions of the same story. (6) How do my parents come in? It includes strategies aiming at awareness, psycho-education, training of parental skills, leisure activities, and teacher training. It aims to encompass the whole school community: students, teachers, psychologists and parents. There are also four after-work sessions to parents and guardians, which are led by school psychologists.

Teachers and psychologists undergo a mandatory 14 hours on-site training before the implementation of the programme; the training is accredited by the Pedagogical Scientific Council of Continuing Teacher Training. Monthly follow-up meetings and monitoring through web platforms are organised to follow progress and evaluate the training sessions, the modules and the sessions with the students.

The programme is based on the Health Belief Model (Rosenstock, 1974) that focuses on health decision making, reflecting on the external factors (supply, experimentation, etc.) and internal factors (self-esteem, beliefs, etc.). The decision to use a particular substance depends upon a person’s capacity to make responsible decisions, and the programme offers practical preventive education. The programme can be adapted to non-school environments, provided that continuous work can be carried out with the participants.

 

Implementation Experiences
Feedback date
Contact details

Amador Calafat  
calafatfar[a]gmail.com

Main obstacles

With respect to individual professionals

About 12 % of teachers say that they have difficulties in dealing with the programme’s interactive methodologies in class. Several follow-up studies have also demonstrated the difficulty that some teachers have in maintaining ‘active neutrality’ (that is, ensuring that their opinion, for example in favour of or against consumption, does not manifest itself).
It is also important to note, as with many programmes, that over the years teachers become less motivated to continue with the programme if there is not adequate support.

With respect to social context

The programme is generally well accepted by teachers, schools and families. The problem usually relates to how to ensure the continued support of the educational leaders of the municipality or region in which the programme is intended to be implemented. Although it is not an expensive programme to implement, there are sometimes other programmes already in operation or it is thought that it is better to have a portfolio of many programmes instead of only programmes that are proven to be effective.

With respect to organisational and economic context

The programme is free. Therefore, problems linked to economic issues are minor, but some costs are inevitable, for training, materials and the monitoring of the teachers who implement the programme. Problems are not usually encountered at the beginning, when the programme is launched, but after a few years. At this time, there is a tendency to decrease both organisational and economic efforts.

In any case, a large organisational structure is not required for the development of the programme.

How they overcame the obstacles

With respect to individual professionals

During the training period, teachers are invited to participate in interactive techniques (role playing etc.) to ensure that they feel comfortable and are trained in the interactive techniques necessary for the implementation of the programme.
When follow-up sessions are conducted, the teachers’ behaviour is reviewed both in the use of interactive techniques, new information and new pedagogical tools and in the maintenance of neutrality and trying to offer the necessary help.
To ensure that the programme continues to be relevant, there must be a supervisory team that transmits the fact that the programme is of interest to the community, that introduces content or complementary techniques, with periodic meetings between the teachers who implement the programme, etc.

With respect to social context

The decision to adopt evidence-based programmes requires increased awareness that only programmes that have proven to be effective should be implemented. This is a long process and in the meantime each case must be resolved individually based on contacts and by publicising the programme.

With respect to organisational and economic context

Each situation is different and therefore the ways in which the problems that arise are overcome vary. As the programme is free, with no charge for its implementation, many of the solutions depend on the local or regional institutions responsible for prevention.

Lessons learnt

With respect to individual professionals

Training for the programme has changed from theoretical training to much more practical and interactive training. At the same time, the duration of initial training has been reduced and the need for the follow-up of teachers who carry out the programme has been reinforced, to support them and to ensure that they complete the training.

With respect to social context

The culture of evaluation and the effective use of public resources is important. Often, programmes that are already being implemented or that are easier to implement are preferred, regardless of their efficacy. There is not much interest in prevention in general.
Improving or changing this situation depends not on the specific efforts of those responsible for a programme but, rather, on wider changes.

With respect to organisational and economic context

There should be a requirement that only evaluated programmes can be implemented.
In particular, in the development of this programme, it is important that the minimum organisational and economic structure required to keep the programme alive is adopted.

Strengths

The various process evaluations show that the programme is well accepted by schools, teachers and students. It is interesting to see how it has expanded in various regions of Spain and in other countries even though there is no central promotion structure or economic interest. It should also be noted that, although it was designed a long time ago, it has managed to maintain levels of acceptance over time, with small adjustments being sufficient (such as incorporating non-chemical dependencies).
It needs a minimal structure of support (preferably external to the school) to ensure its operation. Evaluations also highlight the ease with which teachers can get involved with the implementation of the programme and the high degree of loyalty to the programme year after year, provided a minimum level of follow-up of teachers’ work is maintained.

Weaknesses

The programme usually works better when teachers have volunteered to implement it.
Some teachers have expressed that they feel uncomfortable implementing interactive techniques in class.
The involvement of parents in the programme is always complicated, with varying levels of success (although this is something found with other programmes also).
As with other programmes, it is important that there is supervision of teachers’ work to ensure adherence to the programme as well as its continuity.

Opportunities

We must move towards a situation in which only evaluated programmes are implemented and subsidised. The shortage of such programmes should be an advantage for the adoption of this programme, especially given its high level of acceptance and the fact that few resources are required to support it.

Threats

There is little interest in investing in prevention. Instead, a disinterest in prevention, from social, professional and policy points of view, is detected. Consequently, there is no a great interest in adopting or evaluating new programmes. This trend should be reversed.

Recommendations

With respect to individual professionals

There should not be major problems in adapting the programme for other countries. There are previous experiences of adapting the programme to different contexts, such as for Portugal and Argentina, and no problems have been recorded so far. The material that is used, as well as the accompanying printed comics, would need to be adapted to a certain extent. The teachers of the schools that are going to implement the programme are not expected to have very different characteristics, for the purposes of the needs of this programme, from teachers in Spain.

We believe that the programme is easily adaptable to different contexts.

With respect to social context

The programme presents an active neutrality and does not oblige the school, family, students or teachers to adopt a specific ideological position a priori. But neither does it lead people to feel that they cannot or should not do anything, because in fact it is a decision-making programme. So far, this has not caused any problems and it does not seem to have caused problems in other social contexts either.

With respect to organisational and economic context

It is not a particularly demanding programme, neither in terms of organisational complexity nor in terms of economic requirements.
It is recommended that implementation is started progressively, initially recruiting mostly volunteer teachers. We do not recommend a very long initial training period, but recommend concentrating on following up each teacher during the period in which each teacher implements the programme. This allows training to be completed, questions to be answered, the fidelity of implementation to be reviewed and the continuity year after year of the programme to be ensured.

Number of implementations
1
Country
Country of origin
USA
Last reviewed:
Age group
11-14 years
Target group
Pre-adolescents (11 – 14 years) students of the secondary school
Programme setting(s)
School

The Life Skills Training programme (LST) is a three-year classroom-based universal middle-school prevention programme. It aims to reduce the long-term risk of the use/abuse of alcohol, tobacco and drugs. The life skills curriculum targets social and intrapersonal factors by providing the knowledge, attitudes, and self-management skills necessary to (i) actively resist social influence to engage in substance use, (ii) reduce susceptibility to negative influence, (iii) increase resilience and drug awareness, and (iv) decrease motivation to engage in substance use.

LST was developed in the United States by Gilbert J. Botvin, and adapted to Italy in 2008. It has been scientifically validated in multiple sites.

Contact details

Italy

Corrado Celata
Lifestyles for Prevention, Health Promotion, Screening Division
Welfare General Directorate, Lombardy Region
Email corrado_celata[at]regione.lombardia.it

Programme developer/owner
Gilbert J. Botvin, Ph.D.
Weill Cornell Medical College, New York

Program information contact
National Health Promotion Associates, Inc.
lstinfo[a]nhpamail.com
www.lifeskillstraining.com

Evidence rating
Additional studies recommended
Studies overview

The programme has been evaluated in one quasi-experimental study and one four-year follow-up study in Spain, and one quasi-experimental design in Italy.

The Spanish quasi experimental study was conducted with an intervention group (n=2,567) and a control group (n=2328) enrolled in the last year of Primary Education in Spain (1999) at two time points. Intervention effects were measured by means of chi square, t-tests and tests of covariance. Last month and weekly tobacco use were not significantly affected by the intervention. Initiation of tobacco use among those that had initiated first use was significantly lower in the intervention group. Among those that had already tried alcohol the increase of use was significantly lower in the intervention group. A higher increase of alcohol use in the control group was established. A significantly higher number of participants reduced monthly wine use in the intervention group. There was a significant difference between first time alcohol use between IG and CG. These results should be interpreted cautiously considering that they were studied in a time-frame of only 6 months (November 1997 - January 1998). Effects on 'anti-social behaviour' were analysed but not analysed in relation to the substance use outcomes. 

The Spanish four-year (1995-1999) follow-up study (Gomez Frágüela 2003) involved one control group (n=485) and two intervention groups. The first intervention group (n=235) got the intervention from teachers, the other from professional prevention workers (n=309). A validated questionnaire was administered at four time points and analysed by means of ANOVA and pairwise multiple comparisons. The 15 and 27 months follow-up demonstrated some intervention effects. The 39 month follow up demonstrated similar monthly consumption frequency of tobacco, beer and spirits for all three groups but significantly lower general consumption of cannabis, tranquillizers and amphetamines in the intervention group. Consumption in the two intervention groups was significantly lower compared to the control group.

The Italian quasi-experimental design was conducted among 31 intervention group schools and 24 comparison group schools. The pre-test measurement was conducted prior to the start of the programme, and the post-test eight months after the first year, follow-up after the booster sessions in two subsequent years. The study showed significant effects at post-test in smoking initiation during the first year, weekly drunkenness initiation, and smoking initiation during third years. With regards to alcohol use, there was a lower normative expectation about adults’ drinking and fewer students reported weekly drunkenness. It appears that substance use related differences are less significant at two-year follow-up.

The programme has been rated as Model Plus by Blueprints for Healthy Youth Development based on a review of studies conducted world-wide

References of studies

Outcome evaluations:

Luengo M.M.A.; Romero T.E.; Gómez J.A.; Guerra L.A. and Lence P.M. (1999). La prevención del consumo de drogas y la conducta antisocial en la escuela: Análisis y evaluación de un programa.

Gómez-Fraguela, J.A.; Luengo, M.A.; Romero, E: and Villar, P. (2003). “Building your health”: an empirically-based program for drug abuse prevention.  Revista Internacional de Ciencias Sociales Y Humanidades; SOCIOTAM, 13 (1), 162-202.

Velasco, V., Griffin, K.W., Botvin, G.J. et al. (2017). Preventing Adolescent Substance Use Through an Evidence-Based Program: Effects of the Italian Adaptation of Life Skills Training. Prevention Science. 18 (4): 394-405.

 

Concept papers/other:

Botvin, G. J. (1995). Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. JAMA: The Journal of the American Medical Association,273(14), 1106-1112.

Botvin, G.J., Cornell University. (n.d.). [Brochure].

Botvin, G. J., & Griffin, K. W. (2015). Preventing tobacco, alcohol, and drug abuse through Life Skills Training. In L. M. Scheier (Ed.), Handbook of drug abuse prevention research, intervention strategies, and practice. Washington DC: American  Psychological Association

Botvin, G. J., & Griffin, K. W. (2004). Life Skills Training: Empirical Findings and Future Directions. The Journal of Primary Prevention,25(2), 211-232.

Celata, C., Bergamo, S., Mercuri, F., Velasco, V., & Coppola, L. (2016). “Life SKill Training Lombardia” Report Anno Scolastico 2014-2015(Rep.).

Mihalic, S. Blueprints Programs (n.d.). LifeSkills Training (LST).

Sistema Socio Sanitatio. Regione Lobardia. ATS Milano Città Metropolitana. LifeSkills Training Program Lombardia [programme].

Sistema Socio Sanitatio. Regione Lombardia. ATS Milano Città Metropolitana. Progetto LifeSkills Training Lombardia [website].

Velasco, V., Griffin, K. W., Antichi, M., & Celata, C. (2015). A large-scale initiative to disseminate an evidence-based drug abuse prevention program in Italy: Lessons learned for practitioners and researchers. Evaluation and Program Planning, 52, 27–38.

Countries where evaluated
Italy
Spain
Protective factor(s) addressed
Individual and peers: clear morals and standards of behaviour
Individual and peers: individual/peers other
Individual and peers: Problem solving skills
Individual and peers: refusal skills and decision making
Individual and peers: skills for social interaction
Risk factor(s) addressed
Community: laws and norms favourable to substance use and antisocial behaviour
Outcomes targeted
Education
Other educational outcomes
Emotional well-being
Depression or anxiety
Emotion regulation, coping, resilience
Positive relationships
Substance use
Alcohol use
Use of illicit drugs
Smoking (tobacco)
Bullying
Crime
Violence
Description of programme

The original version of the Life Skills Training programme (LST) is a 3-year universal prevention programme for secondary school students targeting the use of gateway substances (tobacco, alcohol, and marijuana) and violence. It consist of 30 sessions over three years: 15 core sessions in first year, 10 booster sessions in the second year, and 5 booster sessions in the third year (9 in the Italian adaptation). Additionally, there are violence prevention lessons each year (3 in the first and 2 in the second and third years).

LST has three major components: (i) personal self-management skills, which enable students to examine their self-image, set goals, identify everyday decisions, analyse problems and consequences, and reduce stress and anxiety; (ii) social skills, that enable students to overcome shyness, communicate effectively, carry out conversations, handle social requests, and be assertive; and (iii) information and resistance skills specifically related to drug use, that teach students how to recognize and challenge common misconceptions, resistance skills for peer pressure, and decrease normative expectations.

The sessions are delivered by classroom teachers and LST instructions. The skills are taught using interactive teaching techniques, such as instruction, demonstration, feedback, reinforcement, and practice. Teachers guide students in practicing the skills outside the classroom setting. The booster sessions in the following years are designed to reinforce the material, and focus on the continued development of skills and knowledge to enable students to cope more effectively with the challenges they face.

Italian adaptation:

LST was chosen by the Lombardian Government because of its strong evidence-base of effectiveness, theoretical foundation and fit with local needs and Italian professional values. The stakeholders identified an educational approach to prevention that focused on enhancing students’ social and personal skills, consistent with the broader life skills education strategy popular in Italy; the programme was then modified to meet the local needs, traditions, and guidelines with regards to prevention in Lombardy.

All materials used were translated into Italian, adapted to the Italian culture, and integrated with existing complementary instructional materials. For instance, adaptations were made to the content of the program in order to address cultural differences regarding alcohol, drugs, and violent behaviours, and to ensure that behavioural rehearsal and other activities were culturally appropriate to Italian students. Additional adaptations concerned the training and technical support services for health professionals and teachers within the regional infrastructure that disseminates the program. Teachers’ training, technical assistance and on-going support were adapted to address local needs, promote high-quality implementation, integrate the program within local organizational contexts, and strengthen the infrastructure that uses and disseminates the program in order to promote sustainability (Velasco et al. 2015).

LST in Lombardy focuses on specific objectives to each group of recipients:
1. Increase the baggage of personal resources (life skills) in secondary school students;
2. Reinforce teachers' educational functions, modify their representations on health promotion issues, and develop a realistic approach to the current characteristics of substance use;
3. Support, within the school context, a perspective aimed at promoting health and preventing the use of substances, which involves the whole school, encourages mutual support, and integrates the project with the school activities.

Implementation Experiences
Feedback date
Contact details

Susana Redondo Martín
crd[a]jcyl.es

Fernando Martínez González

The implementation experiences regarding programme Building Health

Main obstacles

With respect to individual professionals

  • A wide range of other activities and programmes to be carried out with the students.
  • Finding time to develop the programme. The large number of sessions.
  • Large groups (25 students) or small groups in rural areas (six students) that make it difficult to address some topics.
  • Difficulty of implementing the programme for students with special needs.
  • Lack of student interest in the subject of prevention.
  • Lack of training to deliver skills training (emotional control, self-esteem, assertiveness, peer pressure, decision-making, communication, etc.).
  • Lack of experience with interactive methodologies and difficulties in managing groups.
  • The fear of dealing with information about substances and not knowing how to answer questions or doubts.
  • Poorly updated audiovisual materials.
  • Lack of recognition by the administration of the work involved in the development of the programme.

With respect to social context

  • The community does not demand or support evidence-based, school-based prevention programmes.
  •  The community and its organisations believe that there are simpler ways to approach prevention, but do not have an evidence base.
  • The community does not see the programme as a positive element. Sometimes it is not considered a necessity to believe that we have consumption problems.
  • Lack of continuity of the programme in schools as a result of:
    • limited involvement of 1st and 2nd year secondary education teachers. In many cases it is done in isolated classrooms  and is only due to an individual’s motivation;
    • a large turnover of teaching staff in rural areas.
  • Preferences for other topics by the educational administration and school principals, which often respond to ‘social fashions’ or issues that are the focus of media attention.
  • The schools are committed to specific, simple, striking and less demanding activities for them.
  • Extensive geographical zones, which limit the training due to the travelling involved.
  • Lack of any kind of official recognition by the school.
  • In some schools there are difficulties in the connection and involvement of families.

With respect to organisational and economic context

  • Little support from the education system as a priority programme that adequately motivates teachers to be involved.
  • The structured nature of the programme and the need for its fidelity generates resistance in the educational milieu, as they are programmes that do not originate from these stakeholders.
  • The need to adapt to the changing reality of drugs (advertising, promotion, fake news).
  • The lack of resources to update the manual (design and printing, digital format), and other audiovisual complementary materials.
  • The reduced number of hours of tutoring in the organisational area in which the programme is developed.
How they overcame the obstacles

With respect to individual professionals

  • Planning at the beginning of the course and including it in the tutorial action programme.
  • Using a teacher's manual and workbooks for students.
  • Delivery of the sessions with digital support (activity guide for each session in Keynote presentation app) and with cooperative structures.
  • Reduction of the number of sessions, carrying out only the obligatory ones.
  • Splitting the group into skills and self-esteem sessions.
  • Adaptation of some activities for students with special needs.
  • Adequately informing and showing the benefits to students in their daily lives and for the promotion of their health.
  • Reinforcing the involvement and support of the school’s management team.
  • Using training (very important for overcoming various obstacles), reading of documents and support from the school’s guidance team and the province's prevention professionals.
  • Using videos containing testimonies of teachers with experience in the programme that raise awareness about the problem and motivate participation.
  • Searching for the most up-to-date audiovisual materials.
  • Recognition of the programme with training credits for teachers when carrying out the programme in the classroom.

With respect to social context

  • Involving the faculty and the school and including the programme in the general programming and in the school's educational project.
  • Raising awareness of the need for structured programmes, rather than one-off actions, which are not effective.
  • Proposing the programme to the Pedagogical Coordination Commission, involving the Educational Inspectorate, and forming a working group.
  • Making training more flexible, focusing on the online modality and adapting it for the teaching staff.
  • Seeking the support of the neighbourhood and families for the implementation of the programme. Fostering partnerships that promote community-based prevention at the local level, with an evidence-based, school-based prevention component.

With respect to organisational and economic context

  • Creating a consensual model among councils with competencies in prevention and education.
  • Persuading and involving political decision-makers to support the programme. For this purpose it is important that a professional drugs office advocates resolutely and with continuity for evidence-based prevention programmes.
Lessons learnt

With respect to individual professionals

  • The need for a structured programme of quality and the flexibility to adapt it for further development.
  • Adequately prepare sessions to be effective.
  • The need to dynamise and adapt activities to suit the group/class (encourage participation and teamwork and avoid individuals taking charge).
  • Need to learn and practise skills before delivering the session.
  • The teachers who participate in the programme see it as viable, are satisfied with its implementation, and value its usefulness and the satisfaction of the students.
  • The benefits of teamwork in the school and with those in charge. The essential use of interactive methodologies and group work.
  • After the first year of implementation, the development of the programme is simpler.

With respect to social context

  • The need to raise awareness of the need for intervention with the target population aged 12-14 years (critical periods of sporadic or experimental initiation of consumption).
  • Importance of continuing school-based prevention through accredited quality programmes.
  • Maintain the climate of prevention in the school and the motivation of the teaching staff to give continuity to the programme.
  • The need to remember that it is a complex but achievable process.
  • Renew the presentation of the programme and its implementation, incorporating audiovisual media and other technological innovations.

With respect to organisational and economic context

  • Support from education and drug policymakers is key, as is the involvement of the school management team in promoting the programme.
  • The need for a school-based prevention model that has been agreed upon and continued over time since 1998 (142 827 students since 1998). The training for the implementation is straightforward, carried out in a homogeneous way and recognised by gaining educational credits.
  • It is necessary to have a budget for training and publishing materials, so that schools and students do not have to face any economic costs.
  • Teachers with good experience of the programme are an important motivating element.
Strengths
  • An evaluated programme that has proven to be effective.
  • The programme prevents other types of problem behaviour, such as violence, lack of respect, and lack of cohabitation, and its activities improve other aspects, such as relationships, social skills, self-esteem and emotions.
  • Has a freely accessible manual that is also available online.
  • Teacher training in life skills and strategies for working with them.
  • Has an accredited training course that is offered annually and free of charge to teachers.
  • The annual offer of the materials to all the tutors trained in the 1st and 2nd year of secondary education in the region.
  • Coordination with programmes for out-of-school and family-based substance use prevention (universal, selective and indicated).
  • The education website to disseminate the model.
  • The possibility for teachers to participate in programme monitoring platforms and to be recognised through training credits.
  • Has an autonomous technical directorate in the field of drugs that is resolutely and continuously committed to evidence-based prevention programmes.
  • An inter-administrative structure of people in all the provinces in charge of dissemination, recruitment and monitoring of the schools.
  • A team of teachers with experience of the programme in the classroom who carry out the training of their colleagues in a coordinated manner.
Weaknesses
  • Lack of continuity of the programme in schools for several years.
  • The high turnover of the teaching staff prevents the creation of stable teams and the continuity of the programme.
  • Lack of motivation on the part of teachers to carry out extracurricular activities.
  • Low perception of risk on the part of teachers in relation to consumption, especially of alcohol at an early age (10-11 years).
  • Number of sessions and amount time needed for their preparation.
  • Limited tutoring time to carry out the programme.
  • Old-fashioned format of materials.
  • Lack of incentives for schools that are involved for several years.
  • Teachers’ beliefs about simpler ways to approach prevention, with no evidence base.
Opportunities
  • It has very useful content that is common to other programmes interest in the educational system: emotions, harassment, gender violence, etc.
  • The programme makes it possible to work with active learning methodologies that are currently being promoted.
  • The teachers value the work in social skills and the experience of having applied the programme.
  • Teachers value the positive communication environment in the classroom and that the programme allows them to get to know their students better.
  • The discovery of misinformation, fake news, and errors about the various substances.
Threats
  • Saturation of programmes and activities that fall on the faculty/school.
  • The reduced perception of the importance of the programme after many years of application.
  • The presence of other more novel subjects, with great diffusion of these programmes in the mass media.
  • Social tolerance of drug use, especially alcohol and cannabis.
  • External entities that offer punctual and simpler actions that do not involve the work of the teaching staff.
  • The families do not request this type of training in schools; they consider the academic curriculum to be a priority.
  • Introduction of other educational methodologies based on constructivist models that generate resistance in the application of structured programmes.
  • Overload of actions promoted by the Ministry of Education, which does not perceive the prevention of drug use as a priority issue.
Recommendations

With respect to individual professionals

  • Involve educators who have developed the programme and are satisfied with it for dissemination and teacher training.
  • Publicly acknowledge the good practices of the teachers who implement the programme.
  • Materials must be free for teachers and students.
  • Training and implementation of the programme must have incentives (training credits).
  • Online teacher training, at least in part, to implement the programme.
  • Work with the educational medium on misconceptions about quality prevention.
  • Include the key elements of quality in drug dependence prevention in the teacher training curriculum: degree, masters degree, pedagogical training.

With respect to social context

  • Promote in society the need to work on the prevention of these behaviours.
  • Sensitise society in general (teachers, families, healthcare professionals, social service educators) about the importance of developing quality prevention programmes and not carrying out specific actions.
  • Through family associations, neighbourhood associations, social services and NGOs that work in social action and prevention, disseminate quality programmes, develop them in the classroom and avoiding involving external agents.
  • Coordinate these programmes with other prevention actions in the community, for example in family and after-school programmes.

With respect to organisational and economic context

  • Create an alliance between the administrations responsible for education and prevention to support a quality model with accredited programmes.
  • Establish training to train teachers in the development of the programme.
  • Have an annual budget for training and providing materials to the schools.
  • Incentivise in various ways the schools that carry out the programme (credits, complementary training).
  • Have teams of prevention professionals to promote the programme and monitor it in schools. There should be at least one teacher to sensitise and energise the educational community to carry out the programme.
Note from the authors

Building Health 

Implementers in Castilla  León. Started in 1998, although since 2002 it has been carried out on a generalised basis.

Number of implementations
1
Country
Feedback date
Contact details

Corrado Celata

Lifestyles for Prevention, Health Promotion, Screening Division Welfare General Directorate, Lombardy Region

corrado_celata[at]regione.lombardia.it

Main obstacles

With respect to individual professionals

• In the initial stages of the Lombardy project, health professionals found it difficult to accept the restrictions and adhere to procedures defined by someone else, and they were unsure of both their role in the LifeSkills Training (LST) project and whether the LST programme met the needs of teachers.
• Teachers had some concerns because they were worried that the programme was not appropriate for their students.
• Teachers were not accustomed to implementing structured classroom activities with high fidelity, and were more used to choosing all aspects of their teaching completely autonomously.
• Teachers had difficulties in implementing a classroom programme that used interactive methods and had multiple sessions, including booster sessions, over a period of several school years. The professional training of educators in Italy focuses largely on specific subject matter and less so on teaching methods. Most teachers in Italy have little experience with cooperative learning and interactive teaching methods. Typically, teachers provide lectures to students and are not familiar with teaching methods that involve facilitated classroom discussions or that provide the opportunity for students to practise new skills

With respect to social context

•The school context in Italy is very fragmented: teachers are often isolated, they do not typically work in teams, and principals often have difficulty in managing teachers. Moreover, schools do not often credit teachers for their work in health promotion; there is a high turnover of teachers; and schools have to face increasingly complex situations, such as the ongoing influx of foreign students. These problems were accentuated by the lack of and squandering of resources.
•The educational standards of Italian school systems are focused on liberal arts and philosophy, and lectures and speculative methods are highly valued.
•Prevention and health promotion are not explicitly included in Italian educational standards and the school curriculum.
•Italian teachers place a high value on autonomy and report high levels of satisfaction in their ability to act independently when choosing their method or style of working and teaching.
•Prevention programmes in Italy are typically not as highly structured and prescriptive as the LST programme. Very few programmes use manuals and lists of activities; instead, in practice, they typically involve a series of relatively unstructured discussion points for teachers to incorporate into their lessons.
•The prevention approach is highly influenced by ideological issues, and it is difficult to value the professional and pragmatic point of view in some cases.
•The strong role of families and their values makes it more difficult for schools to have a role in health promotion and prevention.
•There is a different alcohol culture in Italy from that in the USA, where the programme comes from. Italy belongs to the so-called ‘Mediterranean drinking culture’ (or ‘wet drinking culture’), in which moderate alcohol consumption (particularly wine) is considered normal and is part of daily life and family meals. For example, children are often given diluted wine with meals, and the perception is that there are few psychosocial problems regarding alcohol misuse.

With respect to organisational and economic context

• Differences among cities regarding prevention activities.
• Diffusion of many prevention activities without evidence of their effectiveness.
• Squandering of resources.
• Schools’ requests for ineffective activities (e.g. testimonials, talks from experts).
• Increasing levels of inequality.
• A health-promoting schools network has been established just recently, and it provides a fundamental framework for evidence-based programmes.
• The school organisation is fragmented: primary school is focused on educational goals, middle school is a grey area and secondary school is focused on subject goals.

How they overcame the obstacles

With respect to individual professionals

• We selected and used a suitable evidence-based prevention programme that both met the effectiveness criteria and could fit with local needs and professionals’ values in order to improve the quality of their interventions.
• We redefined trainers’ roles and integrated their expertise with the goal of implementing an evidence-based prevention programme. Health professionals needed to adjust the way they worked with teachers. They were used to working closely with schools and teachers, factoring in their stated needs and requests while planning intervention activities. Health professionals needed to adjust their approach to supporting teachers to effectively integrate the use of a new tool (the LST programme) within the context of the existing Italian experience in prevention.
• We defined specific boundaries and at the same time integrated the structure of an evidence-based programme with the help of the health professionals’ and teachers’ expertise.
• We helped health professionals and teachers to increase the skills they needed to refine. The technical assistance was very specific, addressing health professionals’ and teachers’ practices and needs, based on the process evaluation findings. We assisted and supported professionals and organisations continuously, enhancing communities’ competencies to use the programme in a flexible but accurate way.
• We made up groups and teams of health professionals and teachers to better adapt the programme to teacher characteristics and to integrate and combine competencies.

With respect to social context

• Adapted the programme according to the implementation difficulties, context characteristics related to drug use, and teacher and student characteristics.
• Involved several institutions and stakeholders.
• Enhanced local buy-in and integrated LST into the school activities.
• Integrated research-based methods into practice.
• Integrated research, implementation, training and institutionalisation.
• Developed a regional network among schools and health units. This network reinforced the idea that the LST Lombardia project was communal work and helped the teachers involved feel less alone and more supported. It was also an opportunity to share tools, strategies, good practices and results.
• Integrate the work being done at local and regional levels.

With respect to organisational and economic context

• Developed a regional programme.
• Included the dissemination of the programme in the objectives of policymakers and in strategic documents.
• Defined some boundaries to involve most classes and teachers in a school.
• Ensured that the programme had a high impact.
• Planned at a local level (health authority and educational office) which schools to involve, giving priority to schools with risk factors.
• Involved municipalities and other stakeholders in the programme dissemination.
• Monitored the quality of the implementation.
• Involved school principals.
• Continuously reinforced the implementation.
• Promoted strategic and institutional stability.

Lessons learnt

With respect to individual professionals

• Clarify the core elements of the LST programme and the implementation challenges.
• Use research and evaluation to improve the implementation.
• Use a circular method based on the integration of research, practice, training and institutionalisation
• Accept constraints.
• Find the correct fidelity/adaptation balance.
• Integrate previous expertise.
• Support both innovation-specific and general capacity-building.
• Link core elements of the programme to the mission and main activities of communities and organisations.
• Co-plan training courses and activities with the Schools Department at both regional and local levels.
• Constraints can be transformed into resources. The boundaries combined with support can help health professionals and teachers improve their skills and change their behaviours.
• Identify leaders and professionals with high levels of expertise in the different sectors and communities that are involved (health system, school sector, local communities, etc.).
• Involve trainers and leaders who are considered reliable and valuable by the community.

With respect to social context

• Adapt the programme, including the points of view of the implementers (health professionals and teachers) and the target (students), and collaborating with the authors of the programme.
• Use research data to adapt the programme.
• Maintain the features of the programme.
• Make a limited set of changes at the beginning.
• Integrate the program with a global approach sustaining organizations and communities
• Collaborate with leaders of the community with high expertise about the program
• Increase and maintain the alignment of stakeholder needs and the programme.
• Plan and manage a long-term programme.
• Consider the fact that health promotion is not explicitly included in educational standards and the school curriculum as being both an obstacle and an opportunity. On the one hand, it is an obstacle to the integration of an evidence-based programme into the curriculum; on the other hand, it facilitates a cross-educational approach.

With respect to organisational and economic context

• Coordinate the project with other activities and policies in the region.
• Reinforce in each document and policy the importance of the programme.
• Request periodic formal approval or seek support from the administrators of each organisation.
• Institutionalisation is a guarantee of the sustainability of the programme.
• Use evaluation to reinforce the importance of the programme.

Strengths
  • Involving stakeholders in the health sector.
  • Previous expertise of leaders.
  • Use of evaluation to adapt the programme and improve implementation.
  • Collaboration with the author of the programme.
  • Impact of the programme.
  • Life skills are related to all health behaviours.
  • Working groups made up by health professionals, teachers and school principals.
  • Integration through research, implementation, training and institutional actions.
Weaknesses
  • Trainers are all health professionals; teachers should be involved as trainers of trainers.
  • Low competencies in evidence-based programmes of health professionals and teachers.
  • Difficulties in involving some schools.
  • Principal involvement in some schools.
  • Tools need to be updated.
  • More human resources needed.
Opportunities
  • Changes in school policies.
  • Teachers’ need to have instruments for health promotion and for enhancing competencies.
  • Inclusion of the programme in strategic documents and policies.
  • Link with the Health Promoting School Network.
  • Changes in the organisational structure of and professionals working in the health sector.
Threats
  • Resistance to evidence-based programmes.
  • Diffusion of many prevention activities without evidence of their effectiveness.
  • High involvement required.
  • Changes in the organisational structure of and professionals working in the health sector.
Recommendations

With respect to individual professionals

• Accept constraints.
• Support both innovation-specific and general capacity-building.
• Use evaluation and research to improve practice.
• Value continuous technical assistance.

With respect to social context

• Engage all stakeholders in the process.
• Involve leaders.
• Create networks.

With respect to organisational and economic context

• Coordinate the project with other activities and policies in the region.
• Reinforce in each document and policy the importance of the programme.
• Promote institutionalisation.

Note from the authors

Implemented in Lombardia since 2011 to present.

Number of implementations
1
Country
Feedback date
Contact details

Lauren Spiers,
LifeSkills implementation Manager, UK and Ireland
Lauren.spiers[a]barnardos.org.uk

Main obstacles

With respect to individual professionals

  • Initially, commissioners struggled with the American version of the programme and would not consider implementing the programme until a UK adaptation was complete. Other obstacles included a lack of understanding of social and emotional learning programmes within the school setting — no one wanted to take ownership of or responsibility for whether it was health or education. Individuals could not understand that, if we improve children's social competence, this will improve a range of outcomes for children including health and education.
  • Teachers are under so much pressure within the school setting that they initially saw the programme as extra work and not as a way to make life within their classroom easier.

With respect to social context

  • Schools across the regions having varying budgets, with some schools having no money to implement programmes
  • Variations in the programmes implemented across the regions and a lot of schools taking on free non-evidence-based programmes when they were not necessarily the right programmes to be implementing in their schools — no outcomes
  • No guidelines for schools on what to implement
  • Lack of understanding of evidence-based programmes within health and education departments
  • Personal development being mandatory within education systems, but there being no accountability regarding whether schools complete it
  • No recognition for the importance of this type of work, which is academic focused

With respect to organisational and economic context

  • Northern Ireland has no government, so school budgets have been frozen.
  • Social and emotional programmes such as LifeSkills benefits are cross-cutting, which is to their detriment, as no department wants to take responsibility for it.
How they overcame the obstacles

With respect to individual professionals

  • We completed a UK adaptation, alongside the programme developer.
  • We spent a number of years raising the profile of LifeSkills as a social and emotional learning programme in schools that improved children's emotional health and well-being.
  • We linked it to school personal development curriculums across the UK.
  • We provided data to schools to show the impact of the programme, which then helped schools with their inspections.

With respect to social context

  • By encouraging local authority buy in — once the programme has shown positive results in one area, other areas want the same package — and by introducing a linked programme to improve a range of outcomes, including improving resilience and improving education attainment.

With respect to organisational and economic context

  • We subsidised the cost of the programme.
  • We raised awareness among multiple policymakers, including presenting local data showing the impact of the project and not the worldwide evidence base.
Lessons learnt

With respect to individual professionals

  • Implementing an evidence-based programme takes time.
  • Cost effectiveness is important.
  • Proving the personalised outcomes to schools has been a great selling point.
  • Relationships with local authorities and commissioners are crucial.
  • The package of implementation support is imperative to the success of the programme.

With respect to social context

  • Some schools are better than others at recognising the potential impact of the programmes.
  • Make the implementation as easy as possible for the schools.
  • Principal and school senior leadership is essential to the success of the programme.

With respect to organisational and economic context

  • LifeSkills is a universal programme, so this helped commissioners and local authorities invest in the programme, as it was for all children and young people within the classroom setting.
Strengths
  • data per class to show the impact of  the programme that can also be illustrated at school and area level
  • cost-effectiveness
  • evidence base
  • relationship with developer
  • local evidence base
  • link to educational attainment
  • alignment with personal development curriculums
Weaknesses
  • lack of understanding within education on evidence-based programmes
  • schools’ academic focus
Opportunities
  • We have reached a large amount of children and young people since 2012.
Threats
  • Non-evidence-based programmes in schools being trialled for short periods of time that aren’t necessarily effective but have been funded and are free.
Note from the authors

Implemented in various sites across the UK and Ireland, including Liverpool, London, Belfast, Dublin in 2012

Number of implementations
1
Country
Feedback date
Contact details

Prof. Dr Carolien Gravesteijn (Professor of Parenthood and Life Skills)
gravesteijn.c[a]hsleiden.nl

Main obstacles

With respect to individual professionals

There were three obstacles:

  1. Teachers did not always have enough time to follow the training and deliver the programme.
  2. Another obstacle was the continuity; the programme is not a structural part of the curriculum.
  3. We, as developers and researchers, are always dependent on grants.

With respect to social context

We developed a programme for all groups. This was a challenge, because everyone has to recognise themselves in the programme. The teachers received training in which they were able to practise this.

With respect to organisational and economic context

In high schools, only a few teachers follow the training and deliver the programme. An obstacle is that not everyone in the school knows about the programme and that management does not always support the practical conditions, such as providing a classroom and time to deliver the programme, and time for preparation.

How they overcame the obstacles

With respect to individual professionals

We shortened the training for professionals and offered more support during the programme.
There is much interest in the programme. At this moment, we are developing a shorter programme for children (primary school). We will also do this for the programme for adolescents. We advise schools to appoint one life skills ambassador in their school. He or she is responsible for the implementation of the programme.

With respect to social context

The teachers received training in which we taught them how to implement the programme for their own groups. The programme consists of the following structure: first, teaching general life skills, and, second, teaching problem-specific life skills for dealing with situations that are relevant to different groups. All of the teachers received the same manual and were able to make a 'translation' of it for their own groups. This is something that we will practise during the training for teachers.

With respect to organisational and economic context

Schools need to develop Life Skills departments or appoint Life Skills ambassadors in their schools. They are responsible for the implementation, the continuity of the programme and contact with the developers and researchers. The management of the school has to support the programme. It is also important that the whole school knows about the existence of the programme.

Lessons learnt

With respect to individual professionals

  • Organise boost sessions after the implementation of the programme.
  • Keep in contact with the schools.
  • Appoint a Life Skills ambassador in the school.

With respect to social context

During the pilot, we developed a programme for all groups, because we wanted to study the effectiveness of it on different groups. After the pilot, we adapted the programme several times. Our most important lesson was that we have to train teachers during the training on how to implement the same programme for different groups by practising the lessons during the training.

With respect to organisational and economic context

  • Organise information sessions for the whole school about the existence and content of the programme.
  • Make concrete appointments with the management team about the conditions of the implementation of the programme.
Strengths
  • It is an evidence-based programme.
  • It is developed with peer groups.
  • Clients are satisfied.
Weaknesses
  • It is not a programme for the whole school.
Opportunities
  • Provide information sessions for the whole school.
  • Develop Life Skills departments in the schools.
Threats
  • Continuity
Recommendations

With respect to individual professionals

  • Provide training for teachers before you implement the lessons.
  • Adapt the programme, together with the target group (adolescents, teachers and parents).

With respect to social context

  • Involve the whole school.
  • Give information about the programme to the parents and the neighbourhood.

With respect to organisational and economic context

  • Encourage structural investment in Life Skills programmes, because it also stimulates academic learning.
Note from the authors

Life Skills for Adolescents (in Dutch Levensvaardigheden voor Adolescenten). Implemented in some cities in the Netherlands. We are now developing a Life Skills programme for children. We started the development in 1996; the pilot was implemented around 1998. After the pilot, we adapted the programme several times based on research.

Number of implementations
1
Country
Country of origin
Spain
Last reviewed:
Age group
6-10 years
11-14 years
Target group
Family/parents with their children (9-13)/ (8-14)
Programme setting(s)
Family
Level(s) of intervention
Selective prevention

PROTEGO is a selective intervention programme for the prevention of tobacco, alcohol and other drug use in the family. It is a based on the improvement of the educational skills of families through the application of a group intervention.  It consists of eight two-hour sessions for groups of 12 to 15 parents of children and adolescents aged 9 to 13 years. It focuses on developing and enhancing parenting skills, addressing risk factors and family protection through educational activities. It aims to strengthen the bonds between parents and children, and to define and clarify the family´s position on substance use.

Contact details

Jaume Larriba
Technical Director
PDS – Promoción y Desarrollo Social, asociación
C/ Provenza, 79 bajos 3a - 08029 Barcelona (Spain)
Phone ++(34) 934 307 170 – ++(34) 678 505 102 |
Fax ++(34)934 390 773
Email: jlarriba[a]pdsweb.org

Name of organisation: 'P.D.S. – Promoció i Desenvoluapment Social (P.D.S. - Promoción y Desarrollo Social-)'
Street address: Provença street 79, ground flour 3.
Postal code: 08029
City: Barcelona
Country: Spain
Website: www.pdsweb.org
E-mail: aduran[a]pdsweb.org

Evidence rating
Additional studies recommended
Studies overview

The programme has been evaluated in one quasi-experimental study in Spain and one pre-post study with 12 months follow-up without control group. The quasi-experimental study was conducted among families (n=259) served by social services or specialised units in 12 territories, less than 12 months after the intervention (parents with problems of addiction were excluded). The study showed small but significant effects on communication skills, conflict management and cohesion, and family bonding among parents moderated by implementation and participation. There were no outcome measures related to substance use (only parents were evaluated). There was no difference in cohesion, family bonding and family communication.

The longitudinal study was conducted between 12 and 16 months after the pre-test, and 10 – 14 months after the post-test. The study showed statistically significant differences; it showed that all the measures were positive, except for behavioural monitoring, indicating that most outcomes were maintained. Family positioning on drugs increased over time.

References of studies

Outcome evaluation/results

FACTAM (2015). Report on the evaluation of the PROTEGO programme (Rep.)

FACTAM (2016).  Report on the monitoring of the PROTEGO programme 12 months after application (Rep.)

Promocio I Desenvolupament Social, PDS. (2015). Evaluation of the PROTEGO program: Report of results for the territorial teams: Executive Summary (Rep.)

Promocio I Desenvolupament Social, PDS. (2016).  Assessment of the program PROTECT: 12-month follow-up – Executive summary (Rep.)

 

Concept papers/other

Bilbao, R. (2012, August 07). Programa de prevención de consumo de drogas.

Exchange on Drug Demand Reduction Action (EDDRA), EMCDDA. ‘PROTEGO, family training in educational skills for drug prevention’. Summary.

Ficha Villazon – Bolivia. Proyecto savia. Taller sobre calidad de las políticas locales de reducción del consumo de drogas en Iberoamérica [brochure].

La Paz - Bolivia. Taller iberoamericano sobre politicas de drogas en el ambito local [brochure].

Countries where evaluated
Spain
Protective factor(s) addressed
Family: attachment to and support from parents
Family: parent involvement in learning/education
Individual and peers: Problem solving skills
Risk factor(s) addressed
Family: family management problems
Family: parental attitudes favourable to alcohol/drug use
Outcomes targeted
Positive relationships
Relations with parents
Other behaviour outcomes
Description of programme

PROTEGO is a relatively long and intensive prevention program applied to small groups of parents from families that show a cumulative presence of risk factors. The programme’s overall objective is to modify the exposure to family risk and protective factors for substance abuse among high risk children and adolescents. It does so by improving parenting skills (communication, limits, norms, monitoring), strengthening family ties and clarifying the family position in relation to drug use.

PROTEGO is based on the socio-ecological model of drug prevention that addresses personal and environmental factors. The programme targets at-risk families (parents) with adolescent children (9-13 year olds), that have a history of behaviour or school problems which did not require a therapeutic intervention. It consists of 8 two-hour weekly sessions, over the course of two and a half months, where trainers work directly with the parents in a neutral space. The sessions provide direct educational skills for the better development of family relationships. The creation of a group climate facilitates the sharing of problems faced by families and personal difficulties in their education. The programme modules consist of: 1. Definition of behaviour change objectives, 2. Communication skills, 3. Reduction of conflicts and improvement of family relations, 3. Setting standards and limits, 5. Supervision, sanctions and family ties, 6. Family position regarding the use of tobacco, alcohol and other drugs, 7. Troubleshooting, 8. Follow-up.

PROTEGO should be applied by two people: one who guides the training sessions and one who observes and supports the group sessions. The former should have training and experience in the field of psychology, as well as knowledge on drug prevention. The latter may have less experience, however, it is highly recommended that both are trained in the development of the programme.

The programme manual is given to families, as are the summary hand-outs at the end of each session. The manual includes: (i) information on the characteristics of the programme, (ii) guidelines for motivating and retaining families, and (iii) guidelines for its implementation, including session rationale, specific objectives, and detailed description of the procedure. The programme is available on the website of the PDS.

PROTEGO has been widely used since it was first developed and implemented by Promoció i Desenvolupament Social´ (PDS) in 2001; it has also been adapted for implementation in different social and cultural environments. There is a Romanian translation and adaptation of PROTEGO. A Latin American (Spanish and Portuguese) adaptation of the program was developed as a component of an URB-AL project and used in the municipalities involved in the project: Buenos Aires (Argentina), Medellin (Colombia), Montevideo (Uruguay) and Santo André (Brazil). A specific version for Bolivia was also developed.

Following the evaluation of PROTEGO, a new version was edited PROTEGO Version 2. Training on positive parenting and educational skills for mothers and fathers.

Implementation Experiences
Feedback date
Contact details

Jaume Larriba-Montull
jlarriba[a]pdsweb.org

Main obstacles

With respect to individual professionals

The main obstacles for professionals are related to the selection, recruitment and retention of participants and their training of professionals for this purpose. Protego is a selective family prevention programme (aimed mainly at parents lacking skills required to manage challenges and difficulties related to their children’s education). This means that a large proportion of the target population that may benefit from participation in the programme is unaware of the benefits that it can bring and is often reluctant to participate. Therefore, the professionals in charge of recruiting participants (usually social service professionals) must manage such resistance. In addition, these professionals sometimes also have difficulty in determining whether or not an individual meets the requirements for inclusion in the programme or, by contrast, presents criteria for exclusion from participation in the programme.

With respect to social context

The main difficulties are related to some of the characteristics of the people to whom the programme is addressed: external locus of control, low awareness of need and/or low level of commitment to the education of children. In addition, participants also often have difficulties finding care for their children during the programme sessions and it can be difficult finding suitable times for parental participation.

With respect to organisational and economic context

Protego is a selective prevention programme aimed at parents with a low level of commitment to their children’s education and/or with few educational skills and who face difficulties related to family management. This, in addition to the fact that recruitment is usually done through social services, means that potential participants often have a low or very low socioeconomic status. This can sometimes lead to difficulties in attending programme sessions, especially for people living in rural areas and/or in remote areas that are poorly connected to the place where programme sessions are held (due to transport difficulties or cost). The working conditions of these people can also be an obstacle, since often, if they have a job, they have to work variable or unpredictable shifts.

Other obstacles may stem from a lack of interest and/or real political commitment to investing efforts in a programme such as this, which, while proven to be effective, requires significant effort and resources and is targeted at, by their very nature and needs, small groups, as opposed to being a universal prevention intervention.

How they overcame the obstacles

With respect to individual professionals

Training and guidance are provided to the professionals in charge of recruiting participants. In this regard, in the latest revised version of the programme manual the section devoted to providing guidance for the recruitment and retention of participants has been expanded. Such aspects are also included in the training plan for the implementation of the programme. In addition, orientation sessions are usually held with professionals prior to the recruitment of participants in the locations in which the programme is implemented.

With respect to social context

Motivational strategies were used, facilitating as much as possible childcare needs so that parents could participate in the programme and a very flexible schedule for application of the programme was offered.

With respect to organisational and economic context

The involvement and collaboration of grass-roots local professionals were sought, since they understand the needs of the people who can benefit from the intervention.

When possible, additional incentives for participants were provided, such as transport facilities and/or aids.

Promoting the coordination of the contents worked on in the programme with the services that are charged to recruit the participating families, to contribute by this way to consolidate the changes brought about by the implementation of the programme.

Lessons learnt

With respect to individual professionals

An important lesson learnt, as demonstrated by the programme evaluation study, is that difficulties in the recruitment and retention of participants can be overcome (at least at acceptable levels) and are not a real impediment to the implementation of the programme, provided that the guidelines and suggestions for addressing these obstacles provided in both the programme manual and the training programme for its implementation are rigorously followed.

With respect to social context

The importance of using appropriate strategies to address participants’ motivation and the fact that this is key to their recruitment were recognised. Once the programme has started, the use of motivational strategies, social support and adapting schedules, while still important, is less important than the use of motivational strategies for participant recruitment, as the gains derived from participation in the programme reinforce its importance: participation becomes motivating per se as the programme progresses.

With respect to organisational and economic context

After overcoming the initial difficulties, and once the programme has been implemented in a community, the intervention is often repeated and the programme is well accepted in the community. Such consolidation occurs because the people involved usually appreciate that the benefits and positive aspects of programme implementation outweigh the efforts required for implementation. The programme also contributes to overcoming social inequality by helping to empower disadvantaged families in the education of their children.

Another important aspect to bear in mind is that Protego generally targets people who need to make important changes to their educational habits. The evaluation of the programme has shown its capacity to bring about and sustain such changes in the medium term. However, while most participants experience positive changes in their children’s educational habits and patterns after the implementation of the programme, such changes should continue to be reinforced and supported to expand and consolidate them. To this end — given that Protego is a selective intervention programme, whose participants are referred by different social and community care services and resources — these services and resources constitute a very useful tool for giving continuity to the changes brought about by the application of the programme. For all of these reasons, it is advisable to strengthen the articulation of the contents of the programme with the derivative services in order to consolidate the changes brought about by application. To this end, a registration and assessment form for participants is included as an annex to facilitate feedback to the professionals who referred participants to the programme.

Strengths

There is a programme manual. Following evaluation of the initial version of the manual, there is now a revised and updated version, which incorporates improvements based on the evaluation. The manual contains support materials and tools for the process evaluation of the sessions carried out. It includes a training plan for professionals. The programme was designed with sustainability in mind. It has proven to be effective and capable of promoting lasting changes in the participating families.

Weaknesses

It requires trained and motivated resources (staff/professionals), structure (infrastructure and logistics) and well trained professionals. This requires a relatively high level of investment in terms of both resources and cost, especially in the initial stages.

Opportunities

The growing interest in parent education issues and the fight against social inequality may encourage the use of the programme.

Threats

The high number of other interventions, aimed at other family profiles (universal prevention interventions), that are shorter and require fewer resources and less investment, even though not adequate or shown to be not effective in populations with higher levels of exposure to risk factors (selective programmes), may pose a threat by competing with more appropriate but more demanding interventions, such as Protego.

Recommendations

With respect to individual professionals

It is very important to provide training for the professionals involved in the programme, to guarantee both the adequate and the faithful application of the programme and to ensure a good recruitment and retention process for participants.

It is also important to promote interactivity, making the implementation of the programme practical, dynamic and participatory, and to encourage learning by all.

It is important that, during the implementation of the programme sessions, even if a managerial approach is adopted, active listening is practised, mutual support is encouraged and the strengths of the participants are highlighted (so that they develop skills but also perceive personal self-efficacy).

It is also important to encourage the participating families to apply the knowledge and skills acquired in the programme sessions in a real context in order to generalise the learning and verify its validity in the natural environment. For this purpose, each session of the programme includes a section on homework and a section on reviewing homework.

With respect to social context

It is important to ensure that the programme is interwoven with the social and community care services and resources of the territory and that it has the support of professionals from these services.

It may also be important to adapt the examples and exercises of the programme sessions to the characteristics of the local reality.

With respect to organisational and economic context

It is necessary to provide the necessary resources (for recruitment of participants, training of professionals, implementation of programme sessions, monitoring and evaluation, incentives and motivation of participants, etc.).

Number of implementations
1
Country
Country of origin
USA
Last reviewed:
Age group
11-14 years
15-18/19 years
20-25 years
Target group
Antisocial youth and juvenile delinquents aged between 12 and 22 years
Programme setting(s)
Juvenile justice setting
Level(s) of intervention
Indicated prevention

EQUIP is a multi-component cognitive-behavioural programme designed to reduce antisocial behaviour in juvenile delinquents. It is intended to stimulate youth to think and act responsibly using a peer-helping approach. EQUIP focuses on three areas of limitations relating to moral judgment and egocentric bias delay or immaturity, deficits and distortions in social information processing, and deficiencies in social skills. It comprises of three 90-minute meetings per week for ten weeks.

Contact details

Dr. John Gibbs
Department of Psychology
Ohio State University
43210
USA
Email: Gibbs.1[a]osu.edu

Evidence rating
Likely to be beneficial
Studies overview

The programme has been evaluated in five quasi-experimental studies, two studies in the Netherlands and one across the Netherlands and Belgium evaluated the programme with delinquent adolescents, while one study from Netherlands and one from Spain evaluated the programme implemented as universal prevention in schools.

In two Dutch studies, delinquent male adolescents aged 12 to 21 years recruited from three/four similar high-security juvenile correctional facilities participated, intervention group participants came from one facility while the control group from the remaining. In one study, 7/20 outcomes (measuring moral development, social information processing and social skills) showed a significant positive intervention effect. In the other study, there a significant positive intervention effect on cognitive distortions. The study also measured recidivism: the more participants from intervention group reoffended (53% v 29% at 12 months, and 86% v 65% at 24 months), but the difference was not significant.

234 incarcerated youth from high-security juvenile correctional facilities participated in the study, conducted across the Netherlands and Belgium. Intervention and control group participants came from different facilities. The majority (69%) were males, and the mean age was approximately 15.5 years. Significant differences were found between the experimental and control groups in the development of social skills and moral value evaluation both of which had a small to moderate effect size as the intervention group remained stable while the control group’s scores decreased. No significant differences were found between the experimental and control groups in the development of cognitive distortions and moral judgment.

Another Dutch study takes a universal preventive approach and was implemented in schools with students with a mean age of 14 years. 9 schools were assigned to groups according to their ability to implement the programme. There was a significant positive effect on self-serving cognitive distortions and attitudes towards antisocial behaviour in the experimental group compared to the control group, but the effect on prevalence of antisocial behaviour and moral judgement was not significantly different between groups.

The Spanish study was also conducted in schools with 89 participants aged approximately 14-16 years, and evaluated an adaption called EQUIPAR, the Spanish version of EQUIP for Educators. The study had mixed effects on thinking errors and no significant effects on victimisation.

References of studies

*Brugman, D., & Bink, M. (2011). Effects of the EQUIP peer intervention programme on self-serving cognitive distortions and recidivism among delinquent male adolescents. Psychology, Crime & Law, 17 (4), 345-358.

*Helmond, P., Overbeek, G., & Brugman, D. (2012). Programme integrity and effectiveness of a cognitive behavioural intervention for incarcerated youth on cognitive distortions, social skills and moral development. Children and Youth Services Review, 34. 1720-1728

Leeman, L., Gibbs, J., & Fuller, D. (1993). Evaluation of a Multi-Component Group Treatment Programme for Juvenile Delinquents. Aggressive Behavior, 19. 281-292.

*Nas, C., Brugman, D., & Koops, W. (2005). Effects of the EQUIP programme on the moral judgment, cognitive distortions and social skills of juvenile delinquents. Psychology, Crime & Law, 11 (4), 421-434.

*Van der Meulen, K., Granizo, L., and del Barrio, C., (2010). Using EQUIP for Educators to Prevent Peer Victimization in Secondary School. Journal of Research in character Education, 8 (1), 61-76.

*Van Der Velden, F., Brugman, D., Boom, J., and Koops, W. (2010). Effects of EQUIP for Educators on students’ self-serving cognitive distortions, moral judgment, and antisocial behaviour. Journal of Research in Character Education, 8 (1). 77-95.

* Van Stam, M. A., Van der Schuur, W. A., Tserkezis, S., Van Vugt, E. S., Asscher, J. J., Gibbs, J. C., & Stams, G. J. J. M. (2014). The effectiveness of EQUIP on sociomoral development and recidivism reduction: A meta-analytic study. Children and Youth Services Review, 38, 44-51.

Countries where evaluated
Belgium
Netherlands
Spain
Protective factor(s) addressed
Individual and peers: clear morals and standards of behaviour
Individual and peers: individual/peers other
Individual and peers: interaction with prosocial peers
Individual and peers: skills for social interaction
Risk factor(s) addressed
Community: laws and norms favourable to substance use and antisocial behaviour
Individual and peers: anti-social behaviour
Individual and peers: favourable attitudes towards anti-social behaviour
Individual and peers: interaction with antisocial peers
Individual and peers: other
No defined risk factors
Outcomes targeted
Crime
Other behaviour outcomes
Description of programme

EQUIP is a multi-component cognitive-behavioural programme designed to reduce antisocial behaviour in juvenile delinquents. It is designed to teach youth to act responsibly and promotes helping behaviours in an intervention based on the Positive Peer Culture model. The programme is implemented within juvenile correctional facilities, with meetings occurring either during school time or in the living unit.

EQUIP focuses on three areas of limitations relating to moral judgment and egocentric bias delay or immaturity, deficits and distortions in social information processing, and deficiencies in social skills. The programme designers developed a four-category typology of self-serving cognitive distortions: self-serving thinking errors, blaming others, minimizing and mislabelling, and assuming the worst.

The programme is implemented with a number of meetings per week – a minimum of three mutual help meetings and two ‘equipment’ meetings. The equipment meetings comprise ten anger management sessions, ten social skills training sessions and ten decision-making sessions. Each meeting lasts approximately an hour and a half and the curriculum can be completed in ten weeks. The meetings aim to identify behavioural issues and distorted thinking and take steps to control and reduce the problems.

Implementation Experiences
Feedback date
Contact details

Dr JM (Jan) van Westerlaak
Psychologist and Equip trainer
westerla[a]dds.nl

Main obstacles

With respect to individual professionals

The main obstacles are/were time, money and schedules. There are working schedules and the Equip Program has to fit somewhere into the schedule of the institution. Then we had/have to train people to work with the programme. So where in the schedule can you find time to train people as they also have to work? There is almost no time (or money) to let them go to training and so on. I think the picture is clear.

With respect to social context

I do not have a problem with the individual professionals. Mostly the problems come from the organisation, time/money problems or lack of good leadership.

With respect to organisational and economic context

Well, I think I can repeat myself here: the biggest problems are mostly the managers who did not take the Equip Program and all the implementation needs seriously. The professionals mostly were/are very positive about it. The neighbourhood and social system were also mostly positive. Sometimes we would have extra meetings for parents or the young clients’ social-care professionals.

How they overcame the obstacles

With respect to individual professionals

By talking over and over and over again about the importance of the programme, the fact that it is evidence based, that I am a highly educated, experienced and trained professional completely capable of training other professionals and so on, and by persevering like this for years and years and years.

With respect to social context

Talk and talk and talk and keep talking with the management, to convince them to provide enough time and resources for the implementation (time, money, realising people from schedules).

With respect to organisational and economic context

I held meetings for the parents and the clients’ social-care professionals and I talked continually about the programme with everybody involved.

Lessons learnt

With respect to individual professionals

It is very important that an institution or company is fully aware that there will need to be enough time and money available to train the professionals to be competent in the programme. In this way the individual professional can feel supported by their organisation.

With respect to social context

Again, that management can be a more difficult obstacle than an individual professional. And that it would be easier if management would take the Equip Program and the implementation time seriously.

With respect to organisational and economic context

Lesson learned: maintain the enthusiasm of the individual professionals and maybe someday the management will see how important it is to involve the whole organisation in as good an initiative as the Equip Program.

Strengths

Equip is a great evidence-based programme. It is very practical, with handy tools for the individual professional and for the young people/clients. The skills and things they learn can be taken with them to other institutions and used throughout the rest of their lives. Every participant can learn in their own way and at their own level and this brings a positive learning atmosphere to the meetings. The programme also clearly outlines the involvement required of management.

Weaknesses

It is not very clear how to involve less willing managers in the programme when they think 'We do not have enough time' or 'The Equip Program is not about us' or 'This is a thing for the individual professional'.

Opportunities

When management can see that it really helps the individual young client and when society sees that it really can prevent criminal behaviour, the Equip Program is a great opportunity not only for the its young clients but, more importantly, also for the whole of society.

Threats

Competing programmes that are not very good but are easier for management to handle (e.g. more e-learning and pleasing things in it, such as YouTube movies, and programmes with simple requirements) and seem to be doing the same thing but are more compatible with the sometimes lazy attitude of management.

Recommendations

With respect to individual professionals

Know the evidence-based background and the fact that it makes your work easier once you know the Equip Program and have some experience with it. Furthermore, understand how it can improve your personal life!

With respect to social context

Convince the management that they have to be involved in the Equip Program, that they have to take part in the training and even that they should undertake some sessions with the young people to really understand what is so good about the programme.

With respect to organisational and economic context

First the management has to be convinced that they are a part of this programme and that they have to know the programme by heart. Then time, money and a place in the organisation’s schedules for the programme are also very important: there should be enough time to train the professionals and have follow-up days at least once a year.

Note from the authors

I should add that I also have implemented it in other European countries such as Belgium, Hungary, Ukraine and Estonia.

Number of implementations
1
Country
Country of origin
Netherlands
Last reviewed:
Age group
11-14 years
15-18/19 years
Target group
All adolescents
Programme setting(s)
Community
Family
School

The European Smoking Prevention Framework Approach (ESFA) addresses four target groups/situations: young people, parents, schools and the out-of-school situation. Programme components consist of (i) smoking prevention through health education within the curriculum (a range of smoking prevention lessons that use the essential elements of a social skills approach); (ii) stimulating a smoke-free school environment (e.g. smoking regulation policies, smoking cessation training for teachers and parents); and (iii) out of-school regional smoking prevention activities (e.g. ongoing regional publicity and out-of-school smoke-free activities for adolescents). The programme is teacher-led and lasts about two school terms.

The programme has been implemented in six countries. To meet local and cultural needs, each country developed and used its own materials, taking into account the core goals and objectives.

Keywords
No data
Contact details

Professor Hein de Vries PhD
Department of Health Education and Promotion
Maastricht University
PO Box 616, 6200 MD
Maastricht, the Netherlands
Phone: + 31-43-388 2410
E-mail: devries[a]gvo.unimaas

Evidence rating
Possibly beneficial
Studies overview

The programme has been evaluated in one quasi-experimental study across Finland, Denmark, Netherlands, UK, Portugal and Spain. The average age of young people was 13.3 years. Self-reported measures were completed, and all results reported here were post-test.

In Spain, fewer young people in the intervention condition began to smoke (statistically significant) and more participants in the control group began to smoke weekly (only marginally statistically significant p=0.08). There was no effect on intention to take up smoking in the next year.

In Finland, fewer intervention group participants began smoking but this was not a statistically significant effect. Fewer intervention group participants began to smoke weekly (statistically significant at 24 months after baseline, and marginally significant (p=0.06) at 30 months i.e. post-test). There was no effect on intention to take up smoking in the next year.

In Portugal, there were fewer participants from the intervention group who began to smoke, and who began to smoke weekly, compared to the control group. Fewer intervention participants reported intentions to smoke in the next year. (All of these differences were statistically significant.)

In the UK, there was no effect on smoking. However, there was a statistically significant favouring the intervention on intention to take up smoking in the next year.

Counter-productive effects were found in the Netherlands and Denmark, where more participants in the intervention group became smokers and more participants began to smoke weekly compared to the control group. Although the negative effect on weekly smoking was statistically significant in Denmark in the initial years of the programme, the only (negative) effect that was statistically significant at the end of programme was weekly smokers in the Netherlands. The effect on intention to take up smoking in the next year was not statistically significant in either country.

Overall analysis showed that there was a statistically significant effect on weekly smoking, but not on the number of smokers. The study also measured attitudes and self-efficacy using five measures, the effects on which were largely not statistically significant at the end of the programme (30 months from baseline) across the different countries. Overall, fewer intervention participants believed in the advantages of smoking and more intervention participants had social self-efficacy (refraining from smoking in social situations).

References of studies

*Ariza, C., Nebot, M., Tomás, Z., Giménez, E., Valmayor, S., Tarilonte, V. and De Vries, H. (2008), ‘Longitudinal effects of the European smoking prevention framework approach (ESFA) project in Spanish adolescents’, The European Journal of Public Health 18, pp. 491-497.

*De Vries, H., et al. (2003), ‘The European smoking prevention framework approach (ESFA): short-term effects’, Health Education Research 18, pp. 649-663.

*De Vries, H., Dijk, F., Wetzels, J., Mudde, A., Kremers, S., Ariza, C., ... and Candel, M. (2006), ‘The European Smoking prevention Framework Approach (ESFA): effects after 24 and 30 months’, Health Education Research 21, pp. 116-132.

*Vartiainen, E., Pennanen, M., Haukkala, A., Dijk, F., Lehtovuori, R. and De Vries, H. (2007), ‘The effects of a three-year smoking prevention programme in secondary schools in Helsinki’, The European Journal of Public Health 17, pp. 249-256.

Countries where evaluated
Denmark
Finland
Netherlands
Portugal
Spain
United Kingdom
Protective factor(s) addressed
Individual and peers: refusal skills and decision making
Risk factor(s) addressed
Family: parental attitudes favourable to alcohol/drug use
Individual and peers: favourable attitude towards alcohol/drug use
Outcomes targeted
Smoking (tobacco)
Description of programme

The European Smoking Prevention Framework Approach (ESFA) addresses four target groups/situations: young people, parents, schools and the out-of-school situation. Programme components consist of (i) smoking prevention through health education within the curriculum (a range of smoking prevention lessons that use the essential elements of a social skills approach); (ii) stimulating a smoke-free school environment (e.g. smoking regulation policies, smoking cessation training for teachers and parents); and (iii) out-of-school regional smoking prevention activities (e.g. ongoing regional publicity and out-of-school smoke-free activities for adolescents). The programme is teacher-led and lasts about two school terms.

The programme has been implemented in six countries. In each of the participating countries, a special national project manager was appointed, who was responsible for the development and implementation of the project. The project manager worked in conjunction with a national steering group made up of representatives of relevant national organisations in the field of smoking prevention. The content of the ESFA programme was finalised when consensus was reached on goals and core objectives during meetings between the contractors and national project managers. Despite reaching consensus on the core objectives, all countries wanted the freedom to aim for other objectives, so each country used and/or developed its own materials, taking into account the core goals and objectives. The programmes were all implemented in the autumn and winter of 1998, and were all teacher-led.

Finland: this programme has been implemented in 13 experimental schools. The programme includes five one-hour lessons that provide information on smoking prevention in general; how to say no; the consequences of smoking and reasons for smoking; the development of refusal skills; and opinions on and reasons for not smoking. A video demonstrates social influences and a drama group demonstrates social influence resistance skills. The participants do not receive a student manual. The lessons are teacher-led; the teachers receive 20 hours of training, manuals and credits for following training. At school level, the ESFA School Policy Guide is used. Parents receive a ‘Quit & Win’ brochure on smoking cessation and are invited to participate in the ‘Quit & Win’ competition. For the out-of-school component, three posters are developed to be displayed in places in schools where children spend much of their free time. Finally, the participants are sent two tabloid-style newsletters, which include peer models explaining their decision to be non-smokers and offering advice on how to avoid smoking.

Denmark: this programme has been implemented in 30 schools. The programme includes six one-hour lessons that discuss smoking prevention in general; personal responsibility and alternatives to smoking; social pressure; refusal skills; making one’s own choices; skills training; the impact of advertising; and smoking policies. Pupils receive a student manual. Teachers receive a tutorial, background information, transparencies, and worksheets for the children. At school level, the ESFA School Policy Guide is disseminated. Parents receive a letter about the ESFA project, how to discuss tobacco use with their child and how to order smoking cessation materials. For the out-of-school component, two posters are developed for schools, classroom walls, canteens and public places such as libraries, swimming halls and sports centres. The participants are sent three postcards featuring the same images as the posters. Finally, a brochure is disseminated to community youth leaders describing how to discuss non-smoking with adolescents.

The Netherlands: this programme includes five one-hour lessons. The first three lessons consist of the national programme, providing information on general smoking prevention, personal decision making, and intentions. The lessons use teacher and student manuals. Two video lessons using soap operas demonstrate social influences and social influence resistance skills using verbal and non-verbal communication. At school level, the ESFA School Smoke-Free Policy Guide is used. Regional health coordinators receive a package describing how to inform parents and school personnel about smoking prevention and the ESFA project, along with examples of presentations and letters introducing the ESFA project, promotional materials (posters, postcards and stickers) and cessation materials. Posters and flyers are disseminated out of school in cases where schools are interested in this.

The United Kingdom: this programme includes five lessons, lasting 30 minutes each. The lessons address smoking prevention in general; economic and environmental consequences of smoking; reasons for smoking; advertising; and decision making. The schoolchildren use worksheets and computer games. Teachers attend a one-day training course and receive manuals. Quit, a national non-smoking organisation, implements drama sessions where children interact with actors, discussing their opinions about smoking and how to stick to their opinions. The Seven Steps to Success policy manual produced by the Health Education Authority is disseminated in schools. There are no parental or community activities.

Portugal: this programme includes six lessons, partly based on the adapted PASE project implemented in Barcelona, that address the effects of tobacco; reasons for not smoking; and social influences, skills and decision making. The schoolchildren use worksheets. Teachers attend a 48-hour training course and receive a manual, and they are given credits for following the training course and giving lessons. Schools receive the ESFA non-smoking policy manual and a non-smoking poster for the national no-smoking day. On that day, teachers receive a letter asking them to discuss issues relating to smoking again with their pupils, and many schools also organise other activities (mainly involving sports). At the community level, the Portuguese health minister and the mayor of the local community publicise the ESFA project on the national no-smoking day.

Spain: in this programme, at the individual level, the PASE project has been adapted to the standards of ESFA, and includes sessions on increasing self-efficacy and training in refusal skills. The materials include teacher manuals, two videos, and worksheets for the children. Pupils receive six lessons on the effects of tobacco; peer pressure; advertising; the prevalence of smoking behaviour; the difficulty of quitting; refusal skills training; and planning future behaviour. Teachers receive four training sessions of two hours. Schools receive the ESFA schools policy manual, along with a letter for parents and non-smoking stickers. One poster is disseminated out of school.

Implementation Experiences
Feedback date
Contact details

Carles Ariza, MD,PhD,MPH
Agència de Salut Pública de Barcelona (Public Health Agency, Barcelona)
cariza[a]aspb.cat

Main obstacles

With respect to individual professionals

The programme is implemented by teachers, with the support of health professionals from the Agència de Salut Pública de Barcelona (the Public Health Agency of Barcelona (ASPB)) for resources and training.
The main obstacle is the lack of training in and awareness of teaching professionals with regard to the importance of smoking and alcohol consumption prevention among young people.

With respect to social context

The main obstacle until now has been that the implementation of health promotion programmes in school is not mandatory for schools.
Second, being the oldest programme offered by the ASPB, we have observed a certain difficulty in maintaining the interest of schools that have previously been regular participants.
Third, as it is a programme that, above all, addresses smoking prevention, and smoking has decreased over recent years among young Spaniards, schools believe that the programme is no longer necessary.

With respect to organisational and economic context

The main obstacle is that the programme has to compete with other preventive programmes, and also other proposals from other companies and bodies, which in most cases have not been evaluated.
In addition, many of these offers are made with the proposal that the intervention be carried out by a health professional, supplanting the teacher.

How they overcame the obstacles

With respect to individual professionals

Despite the obstacles, the programme covers about 35-40 % of schools in the city.
Each year, the ASPB calls on schools to participate in the programme and a training and counselling workshop is held for new implementer professionals at its premises.

With respect to social context

We have attempted to renew and update the programme, with major and minor changes, but not as often as we would have liked. The most recent version, the fourth, was first used during the 2016-17 school year.
We have also lobbied at the political level, so far without success, for health education to be made a mandatory part of the school curriculum.

With respect to organisational and economic context

The agency has improved the presentation and characteristics of its resources to make them more competitive and has intensified the message to school managers about the importance of preventive interventions being effective. It has also highlighted the lack of sustainability when these interventions are carried out by non-school professionals.

Lessons learnt

With respect to individual professionals

Most importantly, the good response of teaching professionals and schoolchildren to work on social skills and decision-making to enable children to make informed decisions when offered drugs such as tobacco or alcohol.

With respect to social context

A number of schools, which could nonetheless be larger, have decided that the prevention of smoking and other drug addictions should be retained as part of the school curriculum.

With respect to organisational and economic context

In an earlier version of the programme, the cost per student was EUR 12.45. A study showed that the cost-benefit ratio is 22:74 and that, if the programme had a 1 % effectiveness rating (a very conservative assumption), it would prevent 67 children becoming smokers. In the evaluation of the second version (Ariza et al, 2008), the programme PASE.bcn was found to have an effectiveness of 4.6 %. The cost saved was EUR 1 022.78 for each person prevented from smoking (Hormigo, 2009).

Strengths
  • Easy application of the programme.
  • Good coverage, given the context.
  • Good programme effectiveness.
  • Sustainability of the programme over time.
Weaknesses
  • The programme can be tiring for the professionals involved in delivering it.
  • Need for periodic renewal.
  • Competitiveness of the other interventions available.
  • Changes in young smokers’ behaviour.
Opportunities
  • To maintain smoking prevention in an important part of the target population.
  • To keep the teachers involved motivated on the subject.
  • To follow the evolution of the problem and adapt the preventive messages of the programme.
  • To continuously improve the intervention.
Threats
  • Teachers less worried by adolescent smoking behaviour.
  • Lack of regulation and a curricular framework for health education.
  • Difficulty of keeping programme resources up to date.
  • Shortage of curricular time and competition with other training activities.
Recommendations

With respect to individual professionals

Ensure that teachers are sufficiently trained in and committed to the prevention of smoking and use of other addictive substances.
Provide feedback to teachers with data on changes in smoking behaviour and offer them updated preventive resources.

With respect to social context

Emphasise to teachers that the prevention of drug addiction involves teaching a personal skill: learning how to say no when you do not want to participate.
Support public policies on smoke-free places, and also those aimed at limiting the consumption of other addictive substances.

With respect to organisational and economic context

Increase the price of tobacco and alcohol.
Advertising campaigns supporting non-smokers and promoting the enjoyment of free time without drugs can be effective.
It is helpful to provide regular high-quality information to families and school staff on the progress of the implementation of the programme.

Note from the authors

Implemented in the region of Catalunya.
It is also offered, in a complementary way in Spanish, in Navarra.

Number of implementations
1
Country
Country of origin
Italy
Last reviewed:
Age group
11-14 years
Target group
Children aged 12-14 years
Programme setting(s)
School
Level(s) of intervention
Universal prevention

Unplugged is a school-based programme that incorporates components focusing on critical thinking, decision making, problem solving, creative thinking, effective communication, interpersonal relationship skills, self-awareness, empathy, coping with emotions and stress, normative beliefs, and knowledge about the harmful health effects of drugs. The curriculum consists of 12 one-hour units taught once a week by class teachers who have previously attended a 2.5-day training course.

Keywords
No data
Contact details

Professor Federica Vigna-Taglianti, PhD
University of Torino
Regione Gonzole, 10 - 10043 Orbassano (TO),
Italy
Email: federica.vignataglianti[a]unito.it

Johan Jongbloet
HOGENT university of applied sciences and arts
Valentin Vaerwyckweg 1, 9000 Gent,
Belgium
Email: Johan.jongbloet[a]hogent.be

Professor Fabrizio Faggiano, PhD
Avogadro University
Via Solaroli 1
Novara, Italy
Email: fabrizio.faggiano[a]uniupo.it

 

 

 

 

 

 

 

 

Evidence rating
Beneficial
Studies overview

The programme has been evaluated in a cluster randomised controlled trial (RCT) involving children aged 12-14 years in several European countries: Austria, Belgium, Germany, Greece, Italy, Spain and Sweden (Caria et al., 2010; Faggiano et al., 2007, 2008, 2010; Giannotta et al., 2014; Vigna-Taglianti et al., 2009, 2014). A further RCT was conducted in Slovakia (Orosová et al., 2020). There were also two cluster RCT’s in the Czech Republic (Miovsky et al., 2012; Jandáč et al., 2021) involving children with a mean age of respectively 11.8 years and 15 years.

For the cross-country study at post-test, exposure to Unplugged was associated with a statistically significant lower prevalence of self-reported daily use of cigarettes, episodes of drunkenness and cannabis use in the past 30 days in the intervention condition compared with the control condition. Young people receiving the programme were less likely than those in the control condition to move from non-smoking or sporadic smoking to daily smoking. Similar patterns emerged in the use of other substances. An analysis by gender found that delayed progression and enhanced regression were higher in the intervention condition among boys, whereas no, minimal or reverse differences were observed among girls.

At 18-month follow-up (Faggiano et al., 2010; Vigna-Taglianti et al., 2014), the use of tobacco and frequency of drunkenness were lower among students in the intervention condition compared to those in the control condition. Students in the intervention condition showed higher tendencies to remain non-users of tobacco or to regress from occasional to no use. The number of students reporting no drunkenness in the past 30 days was higher among students in the intervention condition compared to those in the control condition. Intervention condition participants also reported fewer alcohol-related behaviour problems compared to controls. Further, participants who reported not drinking at baseline were more likely to retain this status at follow-up after participating in the intervention, and those who reported drinking only occasionally at baseline showed a slower progression towards frequent drinking by follow-up if they participated in the intervention. When considering cannabis use, the proportion of persistent non-users was higher among the intervention condition than the control condition. All of these differences were statistically significant.

The RCT conducted in Slovakia (Orosová et al., 2020) had a sample of 1283 schoolchildren with a mean age of 11.5 years from 63 schools. Assignment to either the control group or the experimental group was conducted randomly at school-level. According to the Cochran Q test, the study showed a statistically significant difference between the experimental group and the control group in an increase of the prevalence rates of alcohol consumption during follow-up (3-month, 12-month and 18-month follow-u However, in this study the quality of the randomisation is low, while the outcome measurement took place shortly after implementation in a target group that is quite young (11)

The first Czech study (Miovsky et al., 2012) found a statistically significant effect favouring the intervention, with intervention participants less likely than those in the control condition to have smoked cigarettes in the last 30 days at 3-, 15- and 24-months post-intervention. At the other two time periods (1 and 12 months), differences between conditions in 30-day cigarette use were not statistically significant. There were no statistically significant differences between intervention and control conditions on lifetime cigarette prevalence rates.

The second Czech study (Jandáč et al., 2021) consisted of 70 schools randomly selected with stratification according to their affiliation with a region and size, assigned to one of three groups (the control group, the intervention group 1 and the intervention group 2 exposed to the Unplugged intervention and n-Prevention. The n-Prevention programme is a follow-up (12 months) programme and consists of four lessons providing a general background addressing social norms, social beliefs, refusal skills, and gender-specific differences, neurological aspects and the effects of substance use.  Children from families where the mother reported using alcohol weekly or less frequently however, reported a decrease in drunkenness in the last 30 days compared to the control group. However, the study found no statistically measurable effect on drinking among children who came from families where the mother uses alcohol more than weekly.  These results were observed at a 24-month follow-up, which implies that the Unplugged programme may not be sufficient for high-risk children. Moreover, it is unclear how randomisation took place, and what the drop-out rate and baseline equivalence was. Additionally, in this study a universal programme was used as a targeted intervention.

References of studies

Caria, M. P., Faggiano, F., Bellocco, R., Galanti, M. R. and the EU-Dap Study Group (2010), ‘Effects of a school-based prevention programme on European adolescents’ patterns of alcohol use’, Journal of Adolescent Health 48, pp. 182-188.

Miovsky, M., Novak, P., Stastina, L., Gabrhelik, R., Jurystova, L. and Vopravil, J. (2012), ‘The effect of the school-based Unplugged preventive intervention on tobacco use in the Czech Republic’, Adicciones 24, pp. 211-218.

Orosová, O., Gajdošová, B., Bacíková-Šléšková, M., Benka, J., & Bavol’ár, J. (2020). Alcohol Consumption among Slovak Schoolchildren: Evaluation of the Effectiveness of the Unplugged Programme. Adiktologie, 20, 89-96

Jandáč, T., Vacek, J., & Šťastná, L. (2021). Studying the effect of the Unplugged prevention programme on children whose mothers report drinking more than weekly.

Papers that were not included in the rating process (all referring to the same study): 

Faggiano, F., Richardson, C., Bohrn, K. and Galanti, M. R. (2007), ‘A cluster randomized controlled trial of school-based prevention of tobacco, alcohol and drug use: the EU-Dap design and study population’, Preventive Medicine, 44, pp. 170-173.

Faggiano, F., Galanti, M. R., Bohrn, K., Burkhart, G., Vigna-Taglianti, F., Cuomo, L., Fabiani, L., et al. (2008), ‘The effectiveness of a school-based substance abuse prevention programme: EU-Dap cluster randomised controlled trial’, Preventive Medicine 47, pp. 537-543.

Faggiano, F., Vigna-Taglianti, F., Burkhart, G., Bohrn, K., Cuomo, L., Gregori, D., Panella, M., et al. (2010), ‘The effectiveness of a school-based substance abuse prevention programme: 18-month follow-up of the EU-Dap cluster randomized controlled trial’, Drug and Alcohol Dependence 108, pp. 56-64.

Giannotta, F., Vigna-Taglianti, F., Galanti, M. R., Scatigna, M. and Faggiano, F. (2014), ‘Short-term mediating factors of a school-based intervention to prevent youth substance use in Europe’, Journal of Adolescent Health 54, pp. 565-573.

Vigna-Taglianti, F., Vadrucci, S., Faggiano, F., Burkhart, G., Siliquini, R. and Galanti, M.R. (2009), ‘Is universal prevention against youths’ substance misuse really universal? Gender-specific effects in the EU-Dap school-based prevention trial’, Journal of Epidemiology and Community Health 63, pp. 722-728.

Vigna‐Taglianti, F. D., Galanti, M. R., Burkhart, G., Caria, M. P., Vadrucci, S. and Faggiano, F. (2014), ‘“Unplugged,” a European school‐based programme for substance use prevention among adolescents: overview of results from the EU‐Dap trial’, New Directions for Youth Development 2014(141), pp. 67-82.

 

Countries where evaluated
Austria
Belgium
Czechia
Germany
Italy
Spain
Sweden
Protective factor(s) addressed
Individual and peers: Problem solving skills
Individual and peers: skills for social interaction
Risk factor(s) addressed
No defined risk factors
Outcomes targeted
Alcohol use
Use of illicit drugs
Smoking (tobacco)
Description of programme

Unplugged is a school-based programme that incorporates components focusing on critical thinking, decision making, problem solving, creative thinking, effective communication, interpersonal relationship skills, self-awareness, empathy, coping with emotions and stress, normative beliefs, and knowledge about the harmful health effects of drugs.

Unplugged particularly emphasised correcting pupils' beliefs about the pervasiveness of substance use ('normative beliefs') by contrasting these with data from surveys of pupils of the same age which typically reveal that average use levels are lower.

The curriculum consists of 12 one-hour units taught once a week by class teachers who have previously attended a 2.5-day training course in the lessons and materials, and in how to teach them using methods which encourage interaction between pupils and between pupils and teachers, such as role-play and giving and receiving feedback in small groups.. Based on teacher feedback and barriers identified during the first implementations of Unplugged, the revised programme's lessons are: 1. Opening Unplugged, 2. To be or not to be in a group, 3. Choices – Alcohol, Risk and Protection, 4. Your beliefs, norms and information – do they reflect reality?, 5. Smoking the cigarette drug – Inform yourself, 6. Express yourself, 7. Get up, stand up, 8. Party tiger, 9. Drugs - Get informed, 10. Coping competences, 11. Problem solving and decision making, 12. Goal setting

Materials can be acessed for free here

This basic curriculum is ideally supplemented either by meetings led by pupils selected by their classmates, or by workshops for the pupils' parents. While in the implementations for the first trial, the curriculum was moderately well implemented, peer-led activities were rarely conducted, few parents attended the workshops, and an important element – role-play – was generally omitted by teachers.

Implementation Experiences
Feedback date
Contact details

Maria Kyriadikou
mkyriakidou[a]pyxida.org.gr

Main obstacles

With respect to individual professionals

Unplugged is implemented by teachers after they are trained, but teachers are not familiar with group work and interactive learning methods, and also they are not always motivated to use these methods in class.

With respect to social context

The school often does not provide the time and the space needed in order to implement prevention programmes like Unplugged. It is not a part of the school curriculum and it depends mostly on the willingness of teachers in order to be implemented.

With respect to organisational and economic context

Prevention programmes should be officially a part of the school curriculum in order for them to be sustainable.

How they overcame the obstacles

With respect to individual professionals

By giving them training using interactive methods in order to experience the benefits of these methods and also by providing them support while they were implementing the programme in their class.

With respect to social context

By trying to motivate teachers and school directors in order to allow the programme to be implemented in their school.

With respect to organisational and economic context

By providing the necessary material to teachers and by offering the training for free.

Lessons learnt

With respect to individual professionals

That prevention programmes must take into account that teachers are mostly using "conservative" teaching methods and adjust their curriculum to this fact by providing alternatives to interactive methods.
Or that prevention programmes should be delivered by professionals who are familiar with group work and interactive methods.

With respect to social context

Prevention programmes should be officially a part of the school curriculum in order for them to be sustainable.

With respect organisational and context

Prevention programmes should be embedded in the organisational context of schools in order for them to have the necessary resources.

Strengths

Attractiveness of the material, effectiveness of the prevention programmes, enthusiastic trainers and teachers.

Weaknesses

No context foreseen for the implementation in schools, limited dissemination, training material should be actualised with new information on drug abuse.

Opportunities

Prevention of drug abuse among teenagers, professional and personal development of teachers.

Threats

No maintenance of the implementation.

Recommendations

With respect to individual professionals

Put more effort into recruiting and training.

With respect to social context

Assure alliances.

With respect to organisational and economic context

Secure resources.

Number of implementations
1
Country
Feedback date
Contact details

Juan Carlos Melero
jcmelero[a]edex.es

Main obstacles

With respect to individual professionals

The lack of training of secondary school teachers in content relevant to the development of the programme, group dynamics and psychosocial skills.

With respect to social context

1. The diversity of preventive programmes in Spain at present (more than 100 according to the reports of the National Plan on Drugs).
2. A certain lack of motivation on the part of the teaching staff.
3. Difficulty participating in training sessions over several hours.

With respect to organisational and economic context

As a consequence of the economic crisis that is still felt in Spain, it is very difficult to find sufficient economic support for the development of programmes like Unplugged.

How they overcame the obstacles

With respect to individual professionals

Dynamising very practical training processes in which the teacher has the opportunity to experience the dynamics that Unplugged proposes. To this end, we have created a team of professionals from different Spanish regions who, once a year, meet to reflect on the ongoing training processes trying to find ways to improve them.

With respect to social context

1. Highlighting the available scientific evidence, although it has not been a motivating criterion either.
2. Implementing mechanisms for monitoring presence and online that facilitate the solution of doubts to teachers.
3. Dynamising formative processes of variable duration (between 3 and 10 hours) and looking for dynamics of online training.

With respect to organisational and economic context

Trying to find funding from private companies and, above all, seeking co-financing from the administrations in whose territories the programme is developed.

Lessons learnt

With respect to individual professionals

It may be convenient to devise online training proposals that seek the maximum interaction that enables face-to-face training. We are launching tools of this type in our Ibero-American School of Life Skills: http://escuela.habilidadesparalavida.net/

With respect to social context

The main lesson is the need to look for ways to make programme implementation more flexible. We are aware that a rigorous implementation should follow the technical model as it was evaluated. However, reality suggests exploring ways of maintaining a certain balance between technical rigor and the school's capacity to take on the development of long-term programmes in a field such as drugs, which today does not concern society.

With respect to organisational and economic context

Although it does not seem easy to achieve, it would be advisable to look for ways in which the educational centres themselves could contribute to the financing of the project activities: training, materials, etc., even if it was a symbolic percentage.

Strengths

Scientific evidence, European value, socio-emotional skills.

Weaknesses

Duration, training, competition with other programmes.

Opportunities

Evidence, recognition by public institutions.

Threats

Sustainability in times of crisis.

Recommendations

With respect to individual professionals

Centre teacher training on the development of social-emotional skills that can be related to other topics: sex education, etc.

With respect to social context

Explore formative formats that facilitate the participation of teachers, seeking balance and respect for the diversity of existing motivations.

With respect to organisational and economic context

Look for ways of co-financing that contribute to making the programme sustainable without great expense to anyone.

Number of implementations
1
Country
Feedback date
Contact details

Maria Rosaria Galanti
rosaria.galanti[a]ki.se
 

Main obstacles

With respect to individual professionals

The programme was time consuming and required more school-time than expected.

With respect to social context

None that I am aware of.

With respect to organisational and economic context

Schools in Sweden are autonomous organisations with a good deal of variation in programmes, pedagogy, etc. In order to implement a school programme this variation has to be taken into account.

How they overcame the obstacles

With respect to individual professionals

During the experimental phase support to teachers by means of reinforcement and a help desk. There was no real dissemination phase in Sweden.

With respect to organisational and economic context

In the experimental phase, site visits were very helpful in order to "adjust" the programme to organisational constraints.

Lessons learnt

With respect to individual professionals

Demanding programmes such as Unplugged, if adopted at all, have a high potential for unsurveilled modifications/adaptations that, with time, make the programme quite different from that originally developed.
In addition, the lack of specific contextual effects undermines the programme's diffusion.

With respect to organisational and economic context

A structured and manualised programme is more difficult to implement in highly variable organisational settings than an unstructured programme.

Strengths

The scientific milieu in which the programme was developed and evaluated. The interest (albeit only initial) of the programme's recipients.

Weaknesses

The lack of flexibility of the programme to highly variable organisations.

Opportunities

To learn in the school environment.

Threats

The lack of convincing results on many outcomes; the lack of resources for active diffusion and support to the recipients (schools).

Recommendations

With respect to individual professionals

Care about motivation and preparedness to adopt evidence-based demanding programmes.

With respect to social context

Is the goal of the programme shared by political/professional stakeholders? Is it a priority?

With respect to organisational and economic context

Obtain central approval from school authorities whenever possible.

Number of implementations
1
Country
Feedback date
Contact details

Martina Feric
martina.feric[a]erf.hr
 

Main obstacles

With respect to individual professionals

Professionals in the schools (social pedagogues) were highly motivated for programme implementation. There was less motivation from the teachers (seeing their involvement in programme as extra (and not paid) job).

With respect to social context

Parent participation was relatively low.

With respect to organisational and economic context

There was the problem to find one school hour extra in school day for programme implementation. Also, in original programme, there are too many activities planned for one lesson (time frame of one lesson in Croatia is 45 minutes) and it wasn't possible to do all activities in 45 minutes. The same problem applied to the parent arm.

How they overcame the obstacles

With respect to individual professionals

We (us as trainers/supervisors and social pedagogues in every school) made special effort to enhance motivation of teachers (e.g. making the education interactive and fun as possible, listening to all of their (anticipated) problems and trying to find solutions, being flexible (as much as we could to keep programme fidelity) in programme delivery); social pedagogues were present in the class for some lessons if the teachers felt that teaching that particular lesson was too challenging for them.

With respect to social context

We tried to motivate parents to participate in the programme by different methods (e.g. information on parent meetings, personal letters, posters at schools).

With respect to organisational and economic context

Most of the school used “class hour” to do the Unplugged.
We worked with the teachers and social pedagogues on shortening activities and, at the same time, keeping the integrity of the programme (e.g. changing the introduction game; in some cases quiz was taken in the class and not in the small groups; discussion instead of role-playing with parents).

Lessons learnt

With respect to individual professionals

There is a need to invest time and effort to “prepare” schools for implementation (e.g. presentation of the programme to all school staff, clear communication of programme implementation organisational needs). The role of the school principal is important – real support to programme implementation, not only in words.

With respect to social context

There is a need for a pilot programme in order to adapt a programme originating elsewhere to this social/cultural context.

With respect to organisational and economic context

The input of participants from programme pilot phase was valuable and had important role in planning organisational aspects of implementation.

Strengths
  1. The advantage of implementing a programme that originated elsewhere is implementing the effective prevention programme with all technical support (training of the people in charge, training of teachers, handbooks, workbooks, protocol for process evaluation etc.). In Croatia there is a lack of model programmes.
  2. The professionals in the schools (social pedagogues) have competencies to deliver the programme and support the teachers in delivery.
Weaknesses

Problem of finding the “space” to deliver a programme in a school day.

Opportunities
  1. Successful implementation of an effective programme from elsewhere with high fidelity is feasible.
  2. Successful implementation of an effective programme can enhance use of quality standards in school-based prevention on national level.  
Threats

The acceptance of tobacco and alcohol use is still high in Croatia and there is a high tolerance towards alcohol use by adults (parents don’t see alcohol and tobacco use as “a big problem”; more like “part of growing up”).

Recommendations

With respect to individual professionals

It is important to assure quality training for programme providers (small groups to ensure maximum interactivity and sharing). If it is possible, supervision should be provided.

With respect to social context

There is a need to invest in preparing schools for programme implementation in the sense of sensitisation and motivation. Having motivated teachers and school counsellors in order to ensure programme fidelity is crucial. Also, it is important to have motivated and supportive school management.

With respect to organisational and economic context

Programme pilot implementation can help to adapt programme delivery to given context and, at the same time, to keep fidelity to the programme.

Note from the authors

Imam stav - Unplugged

Number of implementations
1
Country
Feedback date
Main obstacles

With respect to individual professionals

School-based prevention specialists who are trained get along with the intervention well.
We have little to no information on how the intervention is being implemented by class teachers.

With respect to social context

The intervention is getting old and outdated.

With respect to organisational and economic context

Length of the intervention; 12 lessons to be implemented in one academic school year in all classes in 6th grade (e.g., if one school has 3 classes in a grade this leaves us with 36 lessons to be implemented by how many teachers?)
Cost related to coloured workbook that every child should have.
For some (definitely not for all) costs of + time devoted to the training.

How they overcame the obstacles

With respect to individual professionals

Providing 2-day training for the Unplugged.

With respect to social context

We tried to develop and implement other interventions.

With respect to organisational and economic context

Motivating the implementers.
Explaining why only minor modifications to fidelity (to the content and extent delivered) are possible.

Lessons learnt

With respect to individual professionals

Train, explain, motivate, educate.

With respect to social context

Interventions must be multicomponent, addressing more types of risk behaviours, involving more target groups, systematic.
Working with deliverers.

With respect to organisational and economic context

Fewer lessons.
No coloured workbook, only black and white work sheets.

Strengths

Used and evaluated in Europe widely, High level promotion.

Weaknesses

No successor at hand.

Opportunities

Important lessons learnt from research outcomes.

Threats

Intervention is getting old, Low control of all aspects of fidelity.

Recommendations

With respect to individual professionals

Needs to be revised/updated prior to implementation.

With respect to social context

Needs to be revised/updated prior to implementation.

With respect to organisational and economic context

Needs to be revised/updated prior to implementation.

Number of implementations
1
Country
Feedback date
Contact details

Sanela Talić
sanela[a]institut-utrip.si

 

Main obstacles

With respect to individual professionals

  1. If the teachers voluntarily participated in the training and implementation, the results and their commitment were on a high level.
  2. Another problem was with inclusion of the Unplugged lessons in regular curriculum. Some teachers were claiming that they don't have available lessons for Unplugged although they have flexible curriculum (which means they have many possibilites to incorporate Unplugged lessons in usual lessons). They are afraid to be autonomous so they follow their handbooks because they feel safer that way and don't want to interrupt their routine - there is no cross-curricular integration. Because of the extent of some lessons, those couldn't be implemented in one school hour (45 minutes).
  3. They also think that drug prevention is mostly providing information on drugs and as they don't have knowledge they are not competent to do preventive work.
  4. There are some cases where teachers want to use Unplugged lessons within school camps and do all lessons in a few consecutive days. That approach strongly deviates from the original plan and we don’t recommend it (this is no longer “Unplugged”) – but we don’t have control over it.

With respect to social context

  1. Opinion of some teachers was that prevention should start in early school years (even before) and that parents should be more cooperative. According to their experiences children do not have basic set of manners and values (when they enter the school). Pupils bring family problems to school and all attention is given to solving those problems. It means there is less time for education and learning or strengthening different life skills. They don't feel competent for problem solving, building authority, productive teaching etc.
  2. Low participation of parents.
  3. Prevention in general is not considered as something we do “before problems occur” and often it is connected with substance use. There is no overview over who does the prevention in schools, how it is done, the only thing that matters is that “prevention activities” in a year plan are ticked.
  4. It is very hard to find motivated teachers who are willing to do additional “prevention work”. Schools are not obliged to do “prevention”; at least, the Ministry of Education doesn’t have any expectations, rules and standards regarding prevention work in schools.
  5. In our opinion, wider implementation of quality standards (and the programme) is also hampered by incorrect relations between Ministry of Health and Ministry of Education (prevention programmes are financed by Ministry of Health without agreement or cooperation with Ministry of Education).
How they overcame the obstacles

With respect to individual professionals

Teachers felt more confident knowing that I'm a teacher by profession and that am aware of situation mentioned above. As I am a teacher and know that there are a lot of possibilities to incorporate other content (like Unplugged), I helped them to make a plan, share ideas and experiences from other schools. After the training they realised that drug prevention is not just talking and giving information about drugs. As most of the teachers usually like to follow the instructions, the workbook with detailed instructions for every lesson helped them to feel more confident.

We decided that all training activities will be led by a teacher who has been implementing Unplugged since the very beginning. So, there is an impression that the programme is used in practice, that it can be implemented and new teachers get much practical advice and recommendations from a person who has implemented it over many years.

With respect to social context

Through all these years we have been promoting prevention science and its principles, we have been organising “Slovenian Prevention Days” and training for Unplugged. Beside “Unplugged training” we also offer some basic information on what, how and why some approaches work/don’t work/have iatrogenic effects.

This year we finally got in contact with stakeholders from the Ministry of Education and started to think how to ensure enough school hours for prevention programmes only. The main idea is to ensure at least one whole hour a week (for every single class) – from the beginning till they finish the school.

Regarding low participation of parents - Parents do not want to immediately expose themselves and participate in activities that are provided by original workshops. There is not enough time to create safe environment where parents would cooperate without any reservations. That is why we decided to implement school based prevention programme EFFEKT for parents and to take advantage of parents’ meetings for its implementation. The rate of parents who are taking part in it is around 85%. We are still in the pilot phase of it. And in the future we plan to do research on effectiveness of each individual programme and a combination of both.

Lessons learnt

With respect to individual professionals

Every year (with lot of advocacy and promotion of the programme) we manage to find at least one/two teachers from each interested school who are willing to implement Unplugged and all of them are very motivated after the training. Each year we organise at least two training sessions with 15-20 teachers involved. Sometimes principals and school counsellors also come to get necessary information about the programme (before they decide to start implementing it). Then further implementation depends on whether those teachers have the needed support from the principals and other teachers – we contact schools to inform them how important the work is that their teachers are willing to do and how they can support them.

It’s important to keep the contact with all teachers who decided to implement the programme. Also to organise meetings for them (in order to share their experiences, to share with them new things and information they want to hear, etc.).

With respect to social context

One very special cultural characteristic in Slovenia, which is holding back the progress in the field of prevention, is that people who are doing prevention have a negative attitude towards programmes originating from elsewhere even though they do not know the content of the programmes. They want to reinvent the wheel again and again and have been doing that for more than two decades. The only interest of key actors in the field of prevention is how to get more money for their "unique", mostly one-off activities and they do not care about the quality of it. Work is not conducted in a professional way. They agree that prevention is long term process but they often forget that "how you do it" also matters. What we learned with implementation of Unplugged is that we need to bring good practices to our schools, kindergartens, families etc., of course with some minor changes.

Teachers who are implementing the programmes report about “side”/”secondary” effects of the programme (teachers feel more comfortable in class, relationships among teachers and students and among students are better, some even reported fewer instances of aggressive behaviour). We decided to measure also these reported effects and hopefully we will scientifically prove them which will help with promotion of the programme (it would no longer be only “drug” prevention programme).

Strengths
  1. This programme can successfully be adapted to other contexts (wider community/society, across multiple locations) without compromising effectiveness.
  2. If a programme from elsewhere meets the needs of a certain community then it's reasonable to implement it (with adequate minor changes or adaptations). It takes a lot of effort and time to design and to test a new programme.
  3. Programme with instruction manual that can be easily used.
Weaknesses
  1. “Drug use” prevention programme – the reason why schools are not interested in it (“They don’t have problems with drugs”)
  2. Too long (12 lessons).
Opportunities

Prevention programmes are based on theories which can explain the risk factors for drug use. For example: according to the theory of social learning, individuals learn and develop their personality by observing the behaviour and actions of other people and the consequences of their actions. If for example particular American programme is based on social learning theory, this means that for example focus of the programme (among other focuses) is also in correcting misconceptions. This social influence theory is not characteristic only for people living in U.S. but for all people (we are talking about the human psychology in general). Especially in today's age of globalisation, we (in Europe) are subject to almost the same influences, regardless of where we live. Cultural differences (especially among young people) are now no longer so large and consideration is needed on whether to pay so much attention to cultural adaptation or in other words we shouldn't be so sceptical towards those programmes.

Recommendations

With respect to individual professionals

In every school there are some individuals who are willing to implement quality programmes. It takes time to find them, but once you “have them on board” it is more likely that programme will “live”. It is also important to take into account some other factors that influence the quality of implementation (teachers should have support whenever they need it; it is also important to organise special meetings for teachers who are implementing the programme in schools; etc.)

With respect to social context

Promotion of the programme as something that would help teachers in their teaching, something that would improve the classroom climate and relationships etc., rather than “drug prevention” programme.
Regular advocacy for quality prevention in order to “open the door” to a programme.
Contacting schools over and over again about Unplugged training.

With respect to organisational and economic context

  1. This programme should be supported by responsible authorities and professionals.
  2. It's important that implementers (e.g. teachers) are motivated, commited to their work and that they have professional support by National EU-Dap centre.
  3. It's necessary that all lessons are planned from the very beginning of school year, and to take into account that one lesson can be implemented in two school hours (one after another).
  4. Programme itself is relatively cheap for implementation. You only need funding for regular material printing (more you print less you pay), organisation of training, including fee for the trainer, and some coordination costs (e.g. coordinating staff, travel costs…). Comparing to some other “prevention” activities (e.g. one-off lectures or workshops) the cost for each school is much cheaper and they get structured and manualised programme for many years with no additional costs. In the case of national funding (like in our case) the cost for school is zero (free of any charge). At least on the basis of Slovenian experience with Unplugged the programme could be promoted as very cost effective intervention. And there is also no licence fee or regular (e.g. annual) licensing costs to developers etc. like in the case of some other evidence-based programmes.
Note from the authors

“Izštekani” - Unplugged

Number of implementations
1
Country
Feedback date
Contact details

Kelly Cathelijn
Kelly.cathelijn[a]fracarita.org
 

Main obstacles

With respect to individual professionals

Schools find it difficult to find the time to implement the 12 lessons.
It is not a part of their normal curriculum.

With respect to social context

In the past we have seen that the previous programme wasn't tailored to target groups.
In vocational schools we see that the pupils are more vulnerable to addiction.
Our programme was too theoretical, so we were inclined to redraft it.

With respect to organisational and economic context

We have seen that, while schools are interested in working with ‘Unplugged’, the cost of the programme is an obstacle.

How they overcame the obstacles

With respect to individual professionals

We suggest:
1. Six lessons in the first year and six lessons in the second year.
2. Dividing the lessons among several teachers so that each teacher gives one or two lessons in their course.
3. An extracurricular day in which the lessons are implemented.

With respect to social context

We added more collaborative exercises tailored to target groups.

With respect to organisational and economic context

We sought out local community and service clubs (e.g. Rotarians) to support the schools.

Lessons learnt

With respect to individual professionals

During the training we offer various implementation methods.

With respect to social context

In drug prevention there is a need to follow a differentiated strategy in order to reach several target groups.

With respect to organisational and economic context

Networking is a crucial element if you want to engage several partners in drug prevention.

Strengths
  1. We provide a lot of exercises, so that teachers can choose which exercise is most appropriate for their class.
  2. The quality of the training is appreciated by 90 % of the teachers.
  3. The brand ‘Unplugged’ is well known in Flanders.
Weaknesses
  1. The cost of the programme.
  2. Schools can’t always find the time to implement the programme in an already full curriculum.
  3. Not all teachers are allowed to attend training sessions because of practical issues in schools.
Opportunities
  1. In some regions of Flanders we haven’t reached all schools.
  2. A lot of schools struggle with digital addiction (gaming, smartphones, tablets, etc.).
  3. Local communities feel the need for an effective drug prevention programme.
Threats
  1. School budgets are continuously under pressure.
  2. Schools are expected to deal with a lot of social problems (bullying, health, etc.). However, schools can’t solve all these problems.
Recommendations

With respect to individual professionals

Make sure there are several partners working on drug prevention.

With respect to social context

Make sure the programme is implemented following a differentiated strategy to reach different target groups.

With respect to organisational and economic context

Work together with the local networks and schools.

Number of implementations
1
Country
Feedback date
Main obstacles

With respect individual professionals

The main obstacle was adjusting the content of the information to the specific needs of the country. Another obstacle was adapting the role-play exercises so that all the targets for each lesson could be reached within one hour.

With respect to social context

Some people are reluctant to see drug prevention programmes implemented in schools.

With respect to organisational and economic context

The costs of the materials were quite high, and since our target was to implement the programme in as many schools as possible (at least two in each of the six districts of Bucharest and in each of the 41 counties of Romania), finding resources for these materials is quite a challenge.

How they overcame the obstacles

With respect to individual professionals

All the materials were adapted based on our national drug use surveys.

With respect to social context

Since Unplugged is a programme that develops life skills in order to prevent young people starting to use drugs, it was easy to change that mentality through parents’ meetings, media activities and focus groups in schools.

With respect to organisational and economic context

We managed to secure governmental resources in order to apply our national drug prevention policies. The Romanian Government considers the fight against illicit drug trafficking and abuse a priority and as a result we were able to reach our target in implementing Unplugged.

Strengths

The content and materials are wide-ranging, organised, adapted and useful.

Weaknesses

The costs of printing and the challenges of selecting and developing a network of trained teachers that can implement Unplugged.

Opportunities

Selecting and developing a network of trained teachers that can implement Unplugged.

Threats

The quality of implementation of the programme may decrease as increasing numbers of classes wish to implement Unplugged.

Recommendations

With respect to individual professionals

Carefully select the professionals who will implement the programme.

With respect to social context

Adapt the materials to the level of knowledge of the beneficiaries.

With respect to organisational and economic context

Unplugged should be implemented with no compromises on the aspects of quality printing and materials.

Number of implementations
1
Country
Feedback date
Contact details
Main obstacles

With respect individual professionals

  • Selection of teachers to be trained and to implement the programme.
  • Involvement of only one teacher per school.
  • Teachers are generally used to working alone, and their team-working attitude can be low.
  • Skill-based units are easily skipped, or implemented with limited interactivity.
  • The programme is ten years old. There are no media activities.
  • Motivation of teachers decreasing year by year.

With respect to social context

  • Schools and teachers with a low socio-economic context can be more difficult to involve.
  • Schools can have difficulties in printing Unplugged materials.
  • Schools can have difficulties paying for the teacher training and for the travel of the teachers to the training location.

With respect to organisational and economic context

  • Organisation of calendar for implementation of the 12 units.
  • Time-consuming programme.
How they overcame the obstacles

With respect individual professionals

  • Criteria for choosing teachers to be trained were shared, discussed and recommended with/to the school principals.
  • When organising the teachers’ training, the participation of at least two teachers per school was encouraged.
  • Unplugged trainers promoted a team-working attitude during the teacher training.
  • During teacher training, the importance of the implementation of skill-based units was underlined.
  • All skill-based units were implemented during teacher training.
  • An update of the original Unplugged material was organised, involving the most active teachers and trainers. Content on drug information and media activities were added, some role play stories and other specific situations were revised. New energisers were created.
  • Booster sessions for teachers were organised each year.
  • The very motivated and enthusiastic teachers were involved in teacher training and booster sessions as "testimonials".
  • Unplugged trainers were proactive in supporting and constantly supervising teachers during the school year, and engaging in a relationship based on reciprocal confidence.

With respect to social context

  • Presentations of the programme to schools with a low socio-economic context and meetings with principals and health educators were organised.
  • Unplugged materials were printed by the regional authority or by the local health office and distributed free of charge to schools.
  • Teacher training was free of charge.
  • Teacher training was organised in the city of the schools involved.

With respect to organisational and economic context

  • Calendar for implementation was carefully decided at the beginning of the school year and re-evaluated at regular intervals, possibly every month.
  • Calendar was decided together with school manager and non-Unplugged teachers of the class.
  • Process monitoring tools are useful to monitor the implementation: these tools were presented and distributed to the teachers during teacher training.
  • Splitting the 12 units across two school years: 6 implemented in the first year and 6 implemented in the second year.
  • Sharing/separating the implementation of the 12 units with another Unplugged teacher.
Lessons learnt

With respect individual professionals

  • It is very important that the teacher is interested in the programme; teachers not well motivated won't implement the programme.
  • Creation of an Unplugged teachers group within the school improves implementation and motivation.
  • During teacher training, working in groups is needed.
  • The importance of implementation of skill-based units must be underlined in teacher training.
  • Booster sessions help to maintain interest. Booster sessions should include the presentation of new scientific results (learning) and sessions dedicated to exchange of experiences between teachers (exchange).
  • Trainers must be proactive in contacts with the teachers.
  • Trainers and teachers must be involved in the revision of the material.

With respect to social context

  • Individual meetings with schools are needed.
  • Specific funding for printing Unplugged materials is needed. Better organisation of teacher training is needed.
  • Location of teacher training must take into account availability of teachers to travel.

With respect to organisational and economic context

  • The results of process evaluation – including implementation of the units and satisfaction of teachers and students about the programme – must be reported and given back to teachers in order for them to change organisation of implementation where needed and increase quality of implementation year by year.
  • A certain level of adaptation of the main standardised model of implementation and some flexibility in allowed changes are needed to ensure the highest implementation rate.
Strengths

Effective programme (evaluated). Standardised teacher handbook. Group of people dedicated to the dissemination (coordination centre). Network of trainers and teachers. Booster sessions for trainers and teachers. Collaboration of regional and local authority. Occasions for teachers to improve teaching. Materials and training at no cost for schools and teachers. Nice materials for pupils.

Weaknesses

Time consuming programme (12 units). Programme is ten years old. Media activities and related contents need to be updated. Dissemination is dependent on continuous funding. Lack of collaboration of local authorities. Competition with other similar programmes.

Opportunities

Networking. Group working. Involvement of teachers in the process. Interest of students. Universal programme. Wide autonomy of schools in choosing programmes. Occasion to promote evidence-based approach.

Threats

Decrease of motivation. Lack of funding. Conflicts among trainers. Slow production of scientific results.  Programme is ten years old. Wide autonomy of schools in choosing programmes: competition with other (non-evaluated) programmes.

Recommendations

With respect individual professionals

  • Special care must be applied in selecting teachers for training and implementation of the programme.
  • Booster sessions should be organised.
  • Create a network for teachers to exchange experiences and be part of the programme.
  • Be proactive in the involvement and supervision of schools and teachers.
  • Constantly promote the alliance of school and health sectors.

With respect to social context

  • Special care must be applied with low socio-economic context schools.
  • Funding for materials and training must be obtained.

With respect to organisational and economic context

  • Process monitoring tools must be provided, collected, analysed and reported.
  • Some flexibility in allowing changes in the model of implementation is needed.
Number of implementations
1
Country
Feedback date
Contact details

Kathrin Schütte
Landkreis Emsland
Kathrin.schuette[a]emsland.de

Rainer Lüker
Albert-Trautmann-Schule Werlte
rainer.lueker[a]ats-werlte.de

Main obstacles

With respect individual professionals

The different occupational groups approach the topic differently; here a common path had to be found.

With respect to social context

The different schools (special school, high school, etc.) had very different levels of performance

With respect to organisational and economic context

  • From a purely organisational point of view, it has sometimes been difficult to encourage exchanges and motivate professionals. All the professionals have implemented UNPLUGGED as part of their normal job and were not hired specifically for it.
  • There were no financial barriers for the time being, as UNPLUGGED was introduced under Communities That Care and it was considered useful and necessary by the political representatives.
How they overcame the obstacles

With respect individual professionals

Joint training of different professionals and constant exchange of information.

With respect to social context

In cooperation with the specialists, the programme was adapted to the performance level of the different schools.

With respect to organisational and economic context

As a "coordinator" always be approachable and try to motivate the professionals.

Lessons learnt

With respect individual professionals

For the success of the programme "UNPLUGGED" a constant exchange of information and networking are very important.

With respect to social context

Exchanges with professionals, on such topics as understanding and patience, were particularly important, especially for the weaker students.

With respect to organisational and economic context

Provide transparency to professionals, financial donors and decision-makers.

Strengths
  • Many professionals as multipliers who work together profitably through their different approaches.
  • Secure financing.
  • A versatile programme that fully informs students, not only on addictive substances but also on the topics "strengthening your personality" and "self-esteem".
Weaknesses
  • Many professionals who need to be motivated and who work very differently.
  • Partly complicated substance or expressed in a complicated way.
Opportunities
  • Different approach and different perspectives.
  • Very versatile and extensive programme.
Threats
  • Loss of motivation of the various skilled workers, since success cannot be measured immediately with this programme
Recommendations

With respect individual professionals

Different professional groups often work together profitably. The exchange must then be promoted and demanded from the outside.

With respect to social context

Exchange between and motivation of the specialists should be in the foreground. It is only through them that the programme can be implemented effectively.

With respect to organisational and economic context

  • The financing should be secure for a longer period of time (several years).
  • Regular exchange meetings must be carried out.
Number of implementations
1
Country
Country of origin
Spain
Last reviewed:
Age group
11-14 years
15-18/19 years
Target group
School children aged 14-16 years
Programme setting(s)
School

The Sobre Canyes i Petes programme is a universal, school-based intervention that aims to prevent adolescents (aged 14-16 years) progressing from non-use or ever-use of cannabis to regular cannabis use. The programme is delivered by class teachers during 6-10 class hours of school curriculum time. Activities include the provision of information about cannabis use, discussing the risks and consequences of cannabis use, and skills training on how to refuse offers of cannabis. There is also a family component, through which parents receive guidance on how to discuss the topic of cannabis use at home with their children. The children are also directed to a website where they can access other relevant resources.

Contact details

Mr. Carles Ariza
Public Health Agency of Barcelona
Servei d’Avaluació i Mètodes d’Intervenció
Agència de Salut
Pública de Barcelona
Pl. Lesseps, 1.
Barcelona Spain
Phone: +34 93 238 4545
Email: cariza[a]aspb.cat
Website: http://www.aspb.cat/quefem/escoles/canyes-petes.aspx

Studies overview

The programme has been evaluated in one quasi-experimental study in Spain involving young people aged 14-15 years. It found a statistically significant positive effect 12 months after the intervention ended, with fewer intervention participants compared to control participants having progressed to regular cannabis use.

References of studies

*Ariza, C., Pérez, A., Sánchez-Martínez, F., Diéguez, M., Espelt, A., Pasarín, M. I., ... and Nebot, M. (2013), ‘Evaluation of the effectiveness of a school-based cannabis prevention programme’, Drug and Alcohol Dependence 132, pp. 257-264.

Countries where evaluated
Spain
Protective factor(s) addressed
No defined protective factors
Risk factor(s) addressed
Individual and peers: early initiation of drug/alcohol use
Outcomes targeted
Alcohol use
Use of illicit drugs
Description of programme

The Sobre Canyes i Petes programme aims to prevent young people from progressing from non-use or ever-use of cannabis to regular cannabis use. It was designed following the principles of other recognised interventions that adopt the evidence-based ‘life skills training’ model.

The programme is delivered during school curriculum time, with four sessions of 16 activities to be implemented over 6-10 class hours. Class-based activities include the provision of information about cannabis and social influences on cannabis use; training in how to deal with offers of cannabis and learning to refuse (life skills training and role play); discussions about the consequences of cannabis use and ways to proceed; and watching a DVD with a story that contextualises cannabis use in the student environment. Teachers are responsible for delivering the intervention to their classes, and are provided with training, materials (e.g. the DVD) and technical support from community health teams.

The programme also includes a family component: parents receive a guide to use at home, with materials to help them to interact with their children and discuss the topic of cannabis use. In addition, students are directed to a website (formerly www.xkpts.com — site no longer in use) where they can access other resources relevant to the topic.

Implementation Experiences
Feedback date
Contact details

Carles Ariza, MD, PhD, MPH

cariza[a]aspb.cat

Main obstacles

With respect to individual professionals

The programme is implemented by teachers, with the support of health professionals of the Agencia de Salut Pública de Barcelona (ASPB) (Public Health Agency, Barcelona) for resources and training. The main obstacle is the lack of training and awareness of teaching professionals about the importance of the issue of alcohol and cannabis consumption among young people. On the other hand cannabis preventive messages have to be believable for young people, making the editing of this course much more complicated.

With respect to social context

The main obstacle until now is that the implementation of health promotion programmes in the school is not mandatory for schools. On the other hand, the social image of cannabis in our environment is very tolerant and very accessible, with the acceptance of false beliefs about its value as a herb with relaxing properties. Also the social image of alcohol as a necessary tool for celebrations is very present among adolescents, and even more, their aspiration to use it as a means to disinhibit themselves in leisure places.

With respect to organisational and economic context

Beyond the loyalised schools (35%), in the rest of the schools the decision to participate in the programme is threatened by the instability of the teaching staff, by the competition with other offers on drug addiction programmes and the great competition of extracurricular activities.

How they overcame the obstacles

With respect to individual professionals

The programme’s preventive materials on cannabis were made through a lengthy process, which included a youth writing contest. Participation consisted in sending stories related to lived experiences (directly or indirectly by close friends) about cannabis use. Among the programme’s materials, there is a website (http://www.sortimbcn.cat/xkpts/), included in a larger page on drug dependence prevention of the Public Health Agency of Barcelona (http://www.sortimbcn.cat), where the stories that were most useful for the audiovisual production of the programme can be found.

With respect to social context

The programme tries to develop responsibility in considering these addictive substances. Specific role-play exercises about consequences of alcohol and cannabis abuse, or personal experiences shared by people who have had troubles with consumption of these substances, are used to deal with this important social pressure.

With respect to organisational and economic context

The offer of the programme is presented to the schools every year in the set of all health promotion programmes for the Secondary School. From the Drug Plan of Barcelona, recommendations also come to the schools from the districts. The fact that it is an evaluated programme is valued, with a determined measure of effectiveness, which allows it to compete better with other programmes that have uncertain results.

Lessons learnt

With respect to individual professionals

Teachers appreciate the resources because they notice that they connect with students. The coverage of the programme is stationary (between 30 and 35% of schools in the city) because of the insecurity that teachers feel about these issues and the difficulty in accepting training.

With respect to social context

The programme coexists well with a cannabis-tolerant environment and, at least, has managed to reduce early onset of cannabis use and especially its problematic consumption. At present, we are designing a selective prevention programme on alcohol and cannabis that is tailored to environments where their use is even more accepted.

With respect to organisational and economic context

Taking into account all the components of the programme, including the design and maintenance of the different versions, the costs of health personnel for its design, renovation and maintenance, the educational costs for the programme’s implementation and the costs of the materials, it is estimated that the cost of an annual programme is €129,059.21. For an average coverage of 5,500 schoolchildren, the cost per student is €23.46. That's a good cost-benefit ratio, considering the costs that can be estimated to arise from each person addicted to or with at-risk consumption of alcohol or cannabis in economic and social terms.

Strengths
  • Good acceptance of the programme by young people.
  • Teachers’ satisfaction with the programme is also usually high (7/8 points out of 10).
  • Audiovisual resources are accessible on the web and this simplifies previous problems of infrastructure or access to copies of the materials.
  • The programme makes it possible to bring a debate to the classroom on a topic that is present in the real lives of young people, especially during the weekend.
Weaknesses
  • The complexity of the content for teachers: they do not want to apply it without prior training.
  • It only works when applied with continuity in schools with motivated teachers.
  • It requires a periodic and continuous renewal of materials and resources.
  • It is easy for some of the aspects promoted by the programme to be contradicted by the social norm that is so tolerant of alcohol and cannabis.
Opportunities
  • It is a topic well received by students.
  • A large majority of the boys and girls to whom the programme is directed are at the moment of initiating socialisation with the consumption of alcohol and cannabis.
  • The programme offers an activity to involve parents and offers some guidelines so that they can talk with their children about this topic.
  • The impact to reduce future dangerous consumption is optimal.
Threats
  • The lack of short-term results on preventive behaviour discourages teachers.
  • Lack of a regulation and curricula framework for health education.                   
  • The easy accessibility for obtaining and buying alcohol and cannabis in our environment.
  • The permissiveness and great tolerance of the use of cannabis or alcohol abuse among many of the families.
Recommendations

With respect to individual professionals

  • It is essential to train teachers who will apply the programme for the first time.
  • Do not forget the transcultural adaptation of materials. Audiovisuals, beyond the aesthetic aspects that are overcome over time, pose similar content and problems in the context of European countries.
  • It is also important to exchange information with schools on changes in the prevalence and incidence of alcohol and cannabis use among young people in each context.

With respect to social context

  • In our Spanish environment, an element of tension is the movements and fairs of the hemp sector, which tends to trivialise the consumption of cannabis and its effects. The minimum distance between cannabis clubs and schools has recently been regulated.
  • In Spain it has not yet been possible to pass the child protection law in relation to alcohol consumption.

With respect to organisational and economic context

  • It is important to have the support of the families and the school management. Our programme has a concrete moment in which a specific material is sent to families about how to talk with their children about cannabis, to ensure their support.
  • Our programme is public and the Public Health Agency of Barcelona ensures that every year all interested schools, whether public, private or with an economic agreement, can take part in the programme.
Number of implementations
1
Country
Top