Great Body Shop
A health education school program for urban youth in preschool through sixth grade that aims to reduce substance abuse, violence, and anti-social behavior by fostering the development of skills to achieve a healthy and balanced lifestyle that emphasizes responsibility, reasoned decision-making, and promotes a strong self image.
Program Type
- Drug Prevention/Treatment
- School - Individual Strategies
Program Setting
- School
Continuum of Intervention
- Universal Prevention
Age
- Early Childhood (3-4) - Preschool
- Late Childhood (5-11) - K/Elementary
Gender
- Both
Race/Ethnicity
- All
Endorsements
Blueprints: Insufficient Evidence
Program Information Contact
Children's Health Market
P.O. Box 7294
Wilton, CT 06897
Phone: (800) 848-1958
Fax: (203) 571-1919
Website: www.thegreatbodyshop.net
Brief Description of the Program
The Great Body Shop is a comprehensive health, substance abuse, and violence prevention program. The program includes curriculum covering a broad array of health issues (health knowledge, health choices/behaviors, health self-efficacy, health status, and health behaviors) that are presented in an age-appropriate way and is designed especially for urban youth. It also provides a fully articulated cross-curricular approach for school districts that require additional concentration in one or more of the following specific areas: Substance abuse prevention, social and emotional health, character education, violence prevention (including bullying), critical thinking, asset building, reading, communication, technology and other learning skills. The program is utilized in large inner cities, medium sized metropolitan cities, suburban communities and rural and remote areas. The curriculum contains a Teacher's Guide, Student Issues, and Parent Bulletins that support ten monthly themes, which are taught through forty lessons. Weekly lessons range in length from 20 - 35 minutes at the primary level to 45- 60 minutes at the intermediate level. Weekly lessons include: reinforcement activities, substance abuse/violence prevention portfolio activities, and assessment tools support each monthly theme.The curriculum includes a teacher's guide; each guide includes a classroom copy of the student issue and ten monthly instructional units. Monthly thematic units contain a variety of tools educators may choose to use for their prevention program. These tools allow teachers to customize their instruction to meet district guidelines and integrate the prevention lessons into other parts of the curriculum. Some of the tools found in the teacher's guide include the monthly parent bulletin, four scripted lessons, special education notes, materials list, quiz, homework, substance abuse/violence prevention portfolio activities, and teaching strategies. Additionally there are performance assessment sheets, cross-curricular reinforcement activities, black lined masters, for further reference resources that identify additional materials, community and national organizations, web sites, videos for classroom and family use.
The content of The Great Body Shop is divided among ten subjects or tracks, each of which is developed from one grade level to the next according to state and national guidelines. These are Injury Prevention, Personal Safety, Functions of The Body, Nutrition, Community Health and Safety, Violence Prevention, Self Worth, Growth, Development, and The Cycle of Family Life, Substance Abuse Prevention, HIV/AIDS & Illness Prevention, Environmental Health, Consumer Health, and Physical Fitness. Each grade level of the program from kindergarten through sixth grade is structured so that knowledge, values, life skills and critical thinking skills are introduced through concepts that are age appropriate and familiar. Knowledge is built sequentially. Positive health values and universal values such as trust, love, respect, honesty, perseverance and the pursuit of excellence are encouraged throughout. Substance abuse and violence prevention are integrated into every strand of the program, showing the connection of each to other health concepts.
The Children's Health Market developed the program over the past fifteen years in close cooperation with nationally recognized specialists in the allied health sciences and the field of elementary curriculum design, as well as with community leaders and educators in many roles in school districts across the US. The program uses multiple strategies to ensure that The Great Body Shop has a positive impact on children's health attitudes, knowledge and behavior. Combining current research from the fields of substance abuse and violence prevention, educational psychology, neuroscience and human behavior, the program synthesizes accurate, developmentally appropriate content with effective instructional processes.
During the evaluation, Children's Health Market (CHM) regional coordinators provided implementation support to the schools. Evaluators collected information relevant to the nature of and intensity of contacts between the CHM regional coordinators and the schools. They also performed teacher surveys, teacher focus groups, and key informant interviews. The key informant interviews were designed to record information relevant to the process evaluation, i.e., teacher training, implementation of the curriculum at the school level, barriers and facilitative factors. The key informants were identified through their participation in the 2-day training or through their role within the schools.
Outcomes
Cartland et al., 2003
- The Great Body Shop participants scored significantly higher than the control group participants in health knowledge, health attitude, and health self-efficacy
- Students with greater exposure to the Great Body Shop program (GBS) reported significantly lower use of alcohol, cigarettes, marijuana, and other substances than comparison students not exposed to the GBS program.
- GBS students reported fewer violent acts and conduct problems than comparison students.
- Students exposed to more GBS programming reported significantly more family caring, higher self-esteem, lower emotional distress, and less antisocial behavior compared to the comparison group of Minnesota students who had no exposure to GBS.
- GBS students reported significantly less school, family, and peer risk factors than the comparison students.
- Students with more GBS exposure had significantly better health risk behavior outcomes than those with no exposure.
- There is a general pattern indicating that longer exposure to the GBS curricula results in more desirable behavior and reported protective factors, but pattern over time is inconsistent for antisocial behavior, violence, and conduct.
- In the 1998 data, students with five years of GBS exposure, on 7 of 8 scales, were significantly more likely to report healthier behavior and protective factors; no effects in the 1995 data.
Brief Evaluation Methodology
The Great Body Shop (GBS) has been evaluated three times in studies utilizing quasi-experimental pre- post-test research designs including matched control groups but without random selection of schools or random assignment of schools into treatment conditions. Outcome aims in these studies have examined a wide range of effects. Study One (Cartland et al., 2003) focussed on health knowledge and health attitudes before and after exposure to the GBS program, while the Study Two (Robinson, 1999) collected data on substance use (alcohol, tobacco, marijuana, and other substances), violent acts, conduct problems, and antisocial behavior as well as school, family, and peer risk factors. Study Three (Duncan et al. 2007) examined general health risk behaviors and reanalyzed the data from the Robinson, 1999 study.
Subgroup Analysis Details
All
Source: Washington State Institute for Public Policy
All benefit-cost ratios are the most recent estimates published by The Washington State Institute for Public Policy for Blueprint programs implemented in Washington State. These ratios are based on a) meta-analysis estimates of effect size and b) monetized benefits and calculated costs for programs as delivered in the State of Washington. Caution is recommended in applying these estimates of the benefit-cost ratio to any other state or local area. They are provided as an illustration of the benefit-cost ratio found in one specific state. When feasible, local costs and monetized benefits should be used to calculate expected local benefit-cost ratios. The formula for this calculation can be found on the WSIPP website.
No information is available
No information is available
Program Developer/Owner
Program Specifics
Program Type
- Drug Prevention/Treatment
- School - Individual Strategies
Program Setting
- School
Continuum of Intervention
- Universal Prevention
Program Goals
A health education school program for urban youth in preschool through sixth grade that aims to reduce substance abuse, violence, and anti-social behavior by fostering the development of skills to achieve a healthy and balanced lifestyle that emphasizes responsibility, reasoned decision-making, and promotes a strong self image.
Population Demographics
All children aged K to 6th grade
Target Population
Age
- Early Childhood (3-4) - Preschool
- Late Childhood (5-11) - K/Elementary
Gender
- Both
Race/Ethnicity
- All
Subgroup Analysis Details
All
Other Risk and Protective Factors
Risk: Lack of Quality Health EducationUnhealthy Choices
Risk/Protective Factors
Risk Factors
Protective Factors
*Risk/Protective Factor was significantly impacted by the program
Brief Description of the Program
The Great Body Shop is a comprehensive health, substance abuse, and violence prevention program. The program includes curriculum covering a broad array of health issues (health knowledge, health choices/behaviors, health self-efficacy, health status, and health behaviors) that are presented in an age-appropriate way and is designed especially for urban youth. It also provides a fully articulated cross-curricular approach for school districts that require additional concentration in one or more of the following specific areas: Substance abuse prevention, social and emotional health, character education, violence prevention (including bullying), critical thinking, asset building, reading, communication, technology and other learning skills. The program is utilized in large inner cities, medium sized metropolitan cities, suburban communities and rural and remote areas. The curriculum contains a Teacher's Guide, Student Issues, and Parent Bulletins that support ten monthly themes, which are taught through forty lessons. Weekly lessons range in length from 20 - 35 minutes at the primary level to 45- 60 minutes at the intermediate level. Weekly lessons include: reinforcement activities, substance abuse/violence prevention portfolio activities, and assessment tools support each monthly theme.Description of the Program
The Great Body Shop is a comprehensive health, substance abuse, and violence prevention program, utilized in kindergarten through sixth grade students. The program includes curriculum covering a broad array of health issues (health knowledge, health choices/behaviors, health self-efficacy, health status, and health behaviors) that are presented in an age-appropriate way and is designed especially for urban youth. It also provides a fully articulated cross-curricular approach for school districts that require additional concentration in one or more of the following specific areas: substance abuse prevention, social and emotional health, character education, violence prevention (including bullying), critical thinking, asset building, reading, communication, technology and other learning skills. The program is utilized in large inner cities, medium sized metropolitan cities, suburban communities and rural and remote areas. The curriculum contains a Teacher's Guide, Student Issues, and Parent Bulletins that support ten monthly themes, which are taught through forty lessons. Weekly lessons range in length from 20 - 35 minutes at the primary level to 45- 60 minutes at the intermediate level. Weekly lessons include: Reinforcement Activities, Substance Abuse/Violence Prevention Portfolio Activities, and assessment tools support each monthly theme.The curriculum includes a teacher's guide; each guide includes a classroom copy of the student issue and ten monthly instructional units. Monthly thematic units contain a variety of tools educators may choose to use for their prevention program. These tools allow teachers to customize their instruction to meet district guidelines and integrate the prevention lessons into other parts of the curriculum. Some of the tools found in the teacher's guide include the monthly parent bulletin, four scripted lessons, special education notes, materials list, quiz, homework, substance abuse/violence prevention portfolio activities, and teaching strategies. Additionally there are performance assessment sheets, cross-curricular reinforcement activities, black lined masters, for further reference resources that identify additional materials, community and national organizations, web sites, videos for classroom and family use.
The content of The Great Body Shop is divided among ten subjects or tracks, each of which is developed from one grade level to the next according to state and national guidelines. These are Injury Prevention, Personal Safety, Functions of The Body, Nutrition, Community Health and Safety, Violence Prevention, Self Worth, Growth, Development, and The Cycle of Family Life, Substance Abuse Prevention, HIV/AIDS & Illness Prevention, Environmental Health, Consumer Health, and Physical Fitness. Each grade level of the program from kindergarten through sixth grade is structured so that knowledge, values, life skills and critical thinking skills are introduced through concepts that are age appropriate and familiar. Knowledge is built sequentially. Positive health values and universal values such as trust, love, respect, honesty, perseverance and the pursuit of excellence are encouraged throughout. Substance abuse and violence prevention are integrated into every strand of the program, showing the connection of each to other health concepts.
The Children's Health Market developed the program over the past fifteen years in close cooperation with nationally recognized specialists in the allied health sciences and the field of elementary curriculum design, as well as with community leaders and educators in many roles in school districts across the US. The program uses multiple strategies to ensure that The Great Body Shop has a positive impact on children's health attitudes, knowledge and behavior. Combining current research from the fields of substance abuse and violence prevention, educational psychology, neuroscience and human behavior, the program synthesizes accurate, developmentally appropriate content with effective instructional processes.
During the evaluation, Children's Health Market (CHM) regional coordinators provided implementation support to the schools. Evaluators collected information relevant to the nature of and intensity of contacts between the CHM regional coordinators and the schools. They also performed teacher surveys, teacher focus groups, and key informant interviews. The key informant interviews were designed to record information relevant to the process evaluation, i.e., teacher training, implementation of the curriculum at the school level, barriers and facilitative factors. The key informants were identified through their participation in the 2-day training or through their role within the schools.
Theoretical Rationale
The theoretical rationale was derived from current research in the fields of substance abuse and violence prevention, educational psychology, neuroscience, and human behavior.
Theoretical Orientation
- Cognitive Behavioral
- Biological - Neurobiological
- Normative Education
Brief Evaluation Methodology
The Great Body Shop (GBS) has been evaluated three times in studies utilizing quasi-experimental pre- post-test research designs including matched control groups but without random selection of schools or random assignment of schools into treatment conditions. Outcome aims in these studies have examined a wide range of effects. Study One (Cartland et al., 2003) focussed on health knowledge and health attitudes before and after exposure to the GBS program, while the Study Two (Robinson, 1999) collected data on substance use (alcohol, tobacco, marijuana, and other substances), violent acts, conduct problems, and antisocial behavior as well as school, family, and peer risk factors. Study Three (Duncan et al. 2007) examined general health risk behaviors and reanalyzed the data from the Robinson, 1999 study.
Outcomes (Brief, over all studies)
Study 1 (Cartland, J. 2003): In health knowledge the Great Body Shop participants scored significantly higher than the control group participants. On the health attitude measure the Great Body Shop participants also scored significantly higher (better health attitude) than the control group participants. Lastly, in health self-efficacy the Great Body Shop participants scored significantly higher than the control group participants. No program effects on health behaviors and health status.
Study 2 (Robinson, D. 1999): This study found that students with greater exposure to the Great Body Shop program (GBS) reported significantly lower use of alcohol, cigarettes, marijuana, and other substances than comparison students not exposed to the GBS program. They also reported fewer violent acts and conduct problems than comparison students. Students exposed to more GBS programming report significantly more family caring, higher self-esteem, lower emotional distress, and less antisocial behavior compared to the comparison group of Minnesota students who had no exposure to GBS and who lived in similar communities. GBS students also reported significantly less school, family, and peer risk factors than the comparison students. Lastly, students with more GBS exposure had significantly better health risk behavior outcomes, than those with no exposure.
Study 3 (Duncan, F. 2007): Results of this study for the 1998 data indicate a general pattern that longer exposure to the GBS curricula results in more desirable behavior and reported protective factors, although results over time for antisocial behavior, violence, and conduct were inconsistent. There were no effects in the 1995 data.
Outcomes
Cartland et al., 2003
- The Great Body Shop participants scored significantly higher than the control group participants in health knowledge, health attitude, and health self-efficacy
- Students with greater exposure to the Great Body Shop program (GBS) reported significantly lower use of alcohol, cigarettes, marijuana, and other substances than comparison students not exposed to the GBS program.
- GBS students reported fewer violent acts and conduct problems than comparison students.
- Students exposed to more GBS programming reported significantly more family caring, higher self-esteem, lower emotional distress, and less antisocial behavior compared to the comparison group of Minnesota students who had no exposure to GBS.
- GBS students reported significantly less school, family, and peer risk factors than the comparison students.
- Students with more GBS exposure had significantly better health risk behavior outcomes than those with no exposure.
- There is a general pattern indicating that longer exposure to the GBS curricula results in more desirable behavior and reported protective factors, but pattern over time is inconsistent for antisocial behavior, violence, and conduct.
- In the 1998 data, students with five years of GBS exposure, on 7 of 8 scales, were significantly more likely to report healthier behavior and protective factors; no effects in the 1995 data.
Generalizability
The program had desirable geographic, gender, and economic diversity. However, most of the schools were described as having mostly African American and Latino student bodies. Future research would want to include greater ethnic diversity to improve generalizability of the findings beyond this population. Despite the authors' suspicions about a lack of diversity affecting the results of the evaluation, no race-specific are gender-specific effects are tested.
Potential Limitations
Study 1 (Cartland et al., 2003): The schools were matched at a very basic level (e.g., large school in treatment to control group), however, it is not clear how well the schools were matched (since percentages and numbers were not provided). It is also unclear how the classes were selected to participate in the survey, as no selection procedure was reported. Another limitation was that the original analysis plan was abandoned due to funding problems and problems with the matched control groups' program implementation. So instead of the three part analysis, the analysis reported was a comparison of students in 3rd grade in Spring 2003 (students who have had one year of exposure to the program) with students in 4th grade in Fall 2001 (students with no exposure to the program). Thus, the comparison was not between the matched schools or the students in the matched schools; or it is not clear that the 4th grade cohort was from the original matched control schools. Another limitation was that implementation of the program by schools was inconsistent. Some schools implemented the program late in the school year and some didn't implement the program at all. Only 15 of 24 schools had at least one year of implementation, some schools had to be classified as non-implementers because they began the program too late. This could have confounded the study because they had already received many of the lessons and were then classified as non-implementers. Lastly, the evaluators were not blinded to the treatment conditions and may have been biased in their reports of the program.
Study 2 (Robinson, 1999): Schools were matched on two environmental variables (proximity and economic resource values), the GBS and comparison schools were significantly different on the matching/control variable "proximity". Furthermore, it is unknown how similar the schools were on other behavioral variables such as substance abuse and violence. There is also a selection bias because schools that did not complete the Minnesota Student Survey (which was voluntary) were stripped from the sample. The study compared differences in health risk behaviors within the Great Body Shop Program group, which means that the researchers were comparing risk behavior responses of different groups of 6th grade students in 1995 and 1998 and also different schools could be involved. They suggest that a stronger approach would be to use pre- and post-tests on the same students after exposure to GBS and compare the outcomes to students without such exposure. Another problem with the findings is that the difference scores of students between 1995 and 1998, while related to GBS exposure, may also have been influenced by changes in the student population, in the families of students, or in the school environments that were unknown and therefore could not be measured.
Study 3 (Duncan, 2007): This study reanalyzed data from Robinson, correcting for many of the flaws in the previous analysis. Effect sizes for significant results were small (most of the effect sizes represented less than 1% of the variance explained in the dependent variable). The inability to measure district level effects, the inability to track students over time (1995-1998), and the absence of any pre-test data also limit the findings. Blueprint outcomes of interest (violence, antisocial behavior, and conduct) were inconsistent over time, although they favored the treatment group at year five.
Notes
The Children's Health Market is an educational organization committed to making a contribution to the health of the nation through a K-6 coordinated health education and substance abuse/violence prevention program in which educators, parents and community members work together for the health of all children. Most of all, the organization seeks to create an educational pathway for children to develop skills to achieve a healthy and balanced lifestyle that emphasizes responsibility, reasoned decision-making, and promotes a strong self image.
Endorsements
Blueprints: Insufficient Evidence
Program Information Contact
Children's Health Market
P.O. Box 7294
Wilton, CT 06897
Phone: (800) 848-1958
Fax: (203) 571-1919
Website: www.thegreatbodyshop.net
Study 1
Evaluation Methodology
Design: The study was a quasi-experimentally designed pre/post-test, which included control groups but did not include random selection of schools or random assignment of schools into treatment conditions. There were 24 elementary schools that participated: 12 intervention schools and 12 matched, delayed implementation schools. The schools were chosen to represent the range of types of schools in the Chicago public school system. However, no matching procedure was reported so it is unknown how well the schools were matched. There were 2,180 students who participated in the program (2nd graders = 1,063 and 4th graders = 1,117). Parent and teacher focus groups and interview participants consented in writing to their participation.In each school, two classrooms each in grades 2 and 4 were given a pre-test at baseline (Fall, 2001) and a post-test in year one (Spring, 2002). The selection procedure was not reported, so it is not clear how these classes were selected. The cohorts were followed for a two-year period. A post-test in year 2 (Spring, 2003) was given to students in 3rd and 5th grades. Because of funding shortfalls, the original analysis plan was not feasible. The analysis reported is a comparison of students in 3rd grade in Spring 2003 (students who have had one year of exposure to the program) with students in 4th grade in Fall 2001 (students with no exposure to the program).
Sample: The final sample included 2,180 students with approximately 51% female and 49% male participants. The age range included 2nd and 4th graders, from 7 years to 12 years of age. The majority of students spoke either English (approximately 64% of 2nd graders and 67% of 4th graders) or Spanish (approximately 19% of 2nd graders and 16% of 4th graders) at home as their primary language.
Measures:
Student Surveys: The survey was designed to capture constructs important to the study, including health-related knowledge, attitudes, and behaviors. In addition, the survey measured student's self-efficacy and self-reported health status.
Analysis: ANOVAs were used to compare predicted means for the program schools.
Outcomes
Posttest:Health Knowledge: In health knowledge the Great Body Shop participants (mean health knowledge score = 12.9) scored significantly higher than the control group participants (mean health knowledge score = 12.3).
Health Attitude: On the health attitude measure the Great Body Shop participants (mean health attitude score = 25.8) scored significantly higher (better health attitude) than the control group participants (mean health attitude score = 25.4).
Health Self-Efficacy: In health self-efficacy the Great Body Shop participants (mean health self-efficacy score = 33.6) scored significantly higher than the control group participants (mean health self-efficacy score = 33.3).
Overall: The findings indicated that students who were exposed for at least one year to the Great Body Shop scored higher in health knowledge, health attitude, and health self-efficacy than did students not exposed. The researchers note that the treatment effects of the program are small (generally less than one point on most scales), but point out that they are statistically significant and display a consistent pattern. There were no program effects for health behaviors and health status.
Long-term: This was meant to be a report of the 2-year findings for The Great Body Shop Program. However, due to schools implementing the program late or not at all the analysis could only be performed for one year of data. So the true long-term effectiveness of the Great Body Shop program will need to be demonstrated through future evaluations.
Study 2
Robinson, D. (1999) The impact of The Great Body Shop on student health risk behaviors and other risk and protective factors using the Minnesota Student Survey. An evaluation report to the Children's Health Market.Using data collected from the Minnesota Student Survey, study 2 compared 6th graders who received The Great Body Shop curriculum to those 6th graders who had no exposure to The Great Body Shop in two years, 1995 and 1998.
Design: The study was quasi-experimentally designed and included a data sample from the Minnesota Department of Families, Children and Learning (MDFCL). The study was conducted with permission of the (MDFCL), which required that all district, school, and student identifiers be removed so anonymity of responses to the Minnesota Student Survey (MSS) was maintained in any reporting of results. After preparing a database of Great Body Shop (GBS) exposure levels, proximity to an urban center, and a school economic variable organized by district name and school name, the MDFCL provided the researchers with the MSS student responses, stripped of all district, school and student identifiers. This database was used for all subsequent matching of GBS and comparison groups, and for analyses of the impact of GBS exposure on student outcomes.
Selection of Great Body Shop Districts, Schools and Students: The GBS group was selected by matching school names and addresses provided by the Children's Health Market with the Minnesota Data Center Fall 1998 enrollment database (containing a total of 423 unique district names, and 2,192 unique school names). With both databases the researchers identified 43 schools in Minnesota with GBS exposure in 1995 or in 1998. An intermediary step, carried out by the MDFCL involved matching GBS schools with the student responses to the MSS. The MSS is voluntary - not all students agree to complete the survey - and the total number of GBS schools in the research database was reduced.
Selection of Matching Comparison Districts, Schools and Students: Student exposure to GBS may be influenced by the proximity of students to urban centers and their associated environmental distress. For each school district in Minnesota the researchers calculated a proximity score in driving miles to serve as an index of environmental distress. The individual student average of free and reduced lunches was also calculated for each school as an index of the economic resources available for each school. The selection of comparison schools (and their associated student responses) was completed after the mean proximity values and economic values were determined for the GBS schools. The distribution of the proximity values and economic values for each GBS school were classified so as to facilitate the close matching of the two values with the comparison schools.
Sample: The final sample included 16,435 6th grade students (3,550 GBS Program and 12,885 Control), because of restrictions involved with using the MSS no further demographics could be provided.
Measures: Proximity to an urban setting and the number of free and reduced school lunches served as control variables for selecting the comparison sample in this study. It was hypothesized that proximity to a city and the number of free and reduced lunches are good indicators of a community's health risk characteristics. Families living in and close to city centers are more likely to experience a greater number of stressors and risk factors than families living in suburban and rural settings. Families and children living in communities with low numbers of free and reduced lunches as a percentage of their total enrollment are likely to live in communities with greater community resources, and are likely to experience fewer risks and stressors.
Proximity: Proximity was calculated as the driving distance from St. Paul, Minnesota to the city/town of the school district office using the American Automobile Association Travel Planner software program. The proximity to St. Paul is an index of the distance of a school district from an urban center, a continuous measure in miles from a large city. Proximity to an urban center helps define each district in some relation to an urban, suburban, or rural category.
Economic Resources: To measure the economic resources of each school in each district, the researchers computed the total number of reported free and reduced school lunches and divided that number by the total school enrollment. This resulted in an economic resource index as a ratio of free and reduced lunches to total enrollment.
Exposure to GBS: GBS exposure level was a measure of the average number of years of exposure to GBS for 6th grade students in schools using the GBS program. Exposure is an aggregate measure at the school level.
Substance Abuse Predictors: There were five factors identified that were used to predict substance use problems in the sample: self-esteem, family-caring, others-caring, emotional distress, and antisocial behavior (which asked three questions about the frequency of probelm behaviors over the last year).
Risk and Protective Factor Domains: Using items from the Minnesota Student Surveys, five risk and protective factor domains were created based upon the U.S. Department of Education guidelines: community, school, family, peer, and individual. In addition to the five domains constructed based upon the U.S. Department of Education risk and protective factor guidelines, substance abuse, violence, and conduct domains were created from items in the Minnesota Student Survey.
Analysis: ANOVAs or t -tests were conducted on all outcome measures.
Post-test: Students with greater exposure to the Great Body Shop program (GBS) reported significantly lower use of alcohol, cigarettes, marijuana, and other substances than comparison students not exposed to the GBS program. They also reported fewer violent acts and conduct problems than comparison students. Students exposed to more GBS programming report significantly more family caring, higher self-esteem, lower emotional distress, and less antisocial behavior compared to the comparison group of Minnesota students who had no exposure to GBS and who lived in similar communities. GBS students also reported significantly less school, family, and peer risk factors than the comparison students. Students with more GBS exposure had significantly better health risk behavior outcomes (on substance use, violence, and conduct problems, for the MSS scales, and for risk and protective factors), than those with no exposure.
Generalizability: The Great Body Shop and comparison students could not be matched on a number of general demographic characteristics (ethnicity, family structure, family income levels, and parent's education), because of restrictions imposed on the use of the Minnesota Student Survey. This will make the findings difficult to generalize, as will all the participants being from Minnesota.
Limitations: Schools were matched on two environmental variables (proximity and economic resource values), the GBS and comparison schools were significantly different on the matching/control variable "proximity". Furthermore, it is unknown how similar the schools were on other behavioral variables such as substance abuse and violence. There is also a selection bias because schools that did not complete the Minnesota Student Survey (which was voluntary) were stripped from the sample. The study compared differences in health risk behaviors within the Great Body Shop Program group, which means that the researchers were comparing risk behavior responses of different groups of 6th grade students. They suggest that a stronger approach would be to use pre- and post-tests on the same students after exposure to GBS and compare the outcomes to students without such exposure. Another problem with the findings is that the difference scores of students between 1995 and 1998, while related to GBS exposure, may also have been influenced by changes in the student population, in the families of students, or in the school environments that were unknown and therefore could not be measured. Schools were also different between 1995 and 1998. Analyses did not account for school-level differences.
Study 3
(Duncan, White, and Nicholson, 2007)
The purpose of this study was to replicate and enhance the unpublished analysis of Minnesota Student Survey (MSS) data from 1995 and 1998 that was conducted by Robinson in 1999 (Study 2), using the same data.
Design: A quasi-experimental research design was used in which 6th grade student health risk behaviors were assessed during two time periods (1995 and 1998), and were compared to student responses in schools that did not participate in the GBS program. The design assessed two different groups of students: One in the 6th grade during the MSS administration in 1995 and the other group in 6th grade in 1998. The Minnesota Student Survey (MSS) was administered to public school students in grades 6, 9, and 12 in 1989, 1992, 1995, and 1998. The administration of the MSS reflected the implementation of The Great Body Shop (GBS) comprehensive health education program in Minnesota public schools in 1995 and 1998. The original data set used by Robinson (1999) was not available in it's complete form for this replication and policies now in place in Minnesota prevented the release of the raw data files. In publicly available data files, all geographic detail has been removed, thus the analysis was restricted to the state level. This prevented a full replication of the Robinson (1999) study. For the purposes of this study, the Minnesota Data Center prepared a data set in which districts implementing the GBS curriculum could be identified as such. Two further matching variables were not available for use in the current evaluation and thus neither was controlled for in the analysis: The Proximity score to St. Paul, MN and the percentage of free/reduced lunches at each school. A total of 50,763 6th grade students completed the MSS in the 1995 school year, of whom 3,033 (6%) were in districts using GBS curricula. Because only one district added the GBS in 1994, and another single district added the curriculum in 1995, state policy required that the data provided for analysis did not distinguish between the districts for those two years. As a result, it was not possible to distinguish between students with one year of exposure and those who had just begun the curriculum. Thus, the 1995 data was limited to those districts that had participated since 1993, effectively reducing the treatment sample size to a total of 911 students. Due to the large size of the potential comparison group relative to the treatment group, a 2% random sample of students was drawn from those districts without GBS exposure to form a no-treatment comparison group (n = 885), bringing the effective sample size of the 1995 analysis to 1,796 students. In 1998 a total of 52,547 students in the 6th grade completed the MSS. Of these, 7,230 (13.8%) were from districts implementing GBS curricula. Again, because the potential comparison group was so much larger than the treatment group, a 15% random sample of students from non-GBS districts was drawn for comparison (n = 7,206). In the 1998 sample the treatment and control groups differed significantly on both race and age. The GBS group was more racially diverse than the control group due to the inclusion of one or two majority non-white districts in the GBS analysis. The difference in age between the GBS and control groups was approximately one day, a statistically significant difference that may have little practical significance.
Sample: In 1995 the sample was 50.4% male, 87.6% Caucasian, 12.4% non-Caucasian, with a mean age of just under 12 years. In 1998 the sample was again 50.4% male, 76.2% Caucasian, 23.8% non-Caucasian, with a mean age of just under 12 years.
Measures: The Minnesota Student Survey (MSS) includes questions about the school environment, activities, and health. It asks specifically about behaviors that may put young people at risk: use of alcohol, tobacco, and other drugs; violence; and sexual activity. It asks for the student's perspective on the positive and negative aspects of life. Roughly 200 questions yield a database of 320 variables. Robinson (1999) created 13 scales within the MSS. While Robinson (1999) provided some information on what each construct represented, there was no table identifying what items comprised each scale. Although an attempt was made to reconstruct the 8 scales present in both the 1995 and 1998 data sets (self-esteem, family caring, other caring, emotional distress, antisocial behavior, school risk/protective factors, violence, and conduct), including a reasonable approximation in number and content of items, it is not certain whether these items have been reconstructed accurately. Robinson (1999) did not discuss how scales were calculated, but examination of his table suggests an average was calculated across items to represent a scale score for each individual. The current analysis uses summed scores.
Analysis: Two sample t -tests were conducted to test whether missing data were distributed randomly among the calculated test scores. The results indicated that missing data was not distributed at random; therefore, new values for the missing data were imputed from the available data using regression. Using regression to impute the values for missing data did not substantively alter the mean or standard deviation of the scale scores for either the 1995 or 1998 samples. Analysis of Covariance (ANCOVA) was conducted using self-esteem, family caring, other caring, emotional distress, antisocial behavior, school risk/protective factors, violence, and conduct as the dependent variables and GBS exposure as the independent variable. Age and gender were used as covariates to control for bias due to non-random sampling. Race was also used as a covariate in the 1998 data set. Alpha inflation was controlled using a Bonferonni adjustment.
Outcomes
For the 1995 data there were no significant differences on the three scales measuring behavior (antisocial behavior, violence, or conduct problems) between the treatment and control group. There were no significant differences observed between the treatment and control groups on family caring, other caring, or emotional distress. Students in the treatment group had significantly better scores on the self-esteem and school risk scales as compared to students in the control group.
The 1998 data indicated that students with three and four years of GBS participation differed from all other groups on the antisocial behavior, violence, and conduct problems scales, having worse scores than the control students. Students with five years of participation differed from all groups save those with two years of participation, having better scores than control students. Students with no years of exposure and one or two years of exposure did not differ significantly on these measures. Examination of adjusted mean scores suggests that over time GBS resulted in behaviors that were more positive. The exception to this is the group with three or four years of exposure to the GBS. State rules limiting the identification of districts led to a forced combination of those districts with three and four years of participation into one category. This resulted in a category made up of 60.1% non-Caucasian students (a markedly different racial/ethnic makeup from the other districts). There was no clear pattern of perceptual change among the means on the self-esteem and school risk scales; however, in all reported scores, students with five years of exposure reported higher levels of protective factors. When the number of years students were exposed to the GBS was included as a testable variable, students with five years of GBS exposure were significantly more likely to report healthier behavior and protective factors on 7 of 8 scales. The pattern of effects are inconsistent over time on antisocial behavior, violence, and conduct, although GBS students were more improved than control students on these measures at year 5.
Outcomes - Brief Bullets
- There is a general pattern indicating that longer exposure to the GBS curricula results in more desirable behavior and reported protective factors.
- In the 1998 data, students with five years of GBS exposure, on 7 of 8 scales, were significantly more likely to report healthier behavior and protective factors; however, the pattern is inconsistent over time for antisocial behavior, violence, and conduct problems
- No significant findings in the 1995 data.
Generalizability
The samples were drawn from public school districts in Minnesota. It is unknown to what degree the results may be generalizable to other populations.
Limitations
Effect sizes for significant results were small (most of the effect sizes represented less than 1% of the variance explained in the dependent variable). The inability to measure district level effects, the inability to track students over time (1995-1998), and the absence of any pre-test data also limit the findings. Inconsistent findings on antisocial behavior, violence, and conduct over time.