My da|ra Login

Detailed view

metadata language: English

Head Start CARES Demonstration: National Evaluation of Three Approaches to Improving Preschoolers' Social and Emotional Competence, 2009-2015

Version
v0
Resource Type
Dataset : observational data, survey data
Creator
  • Morris, Pamela
Other Title
  • Head Start Cares (Alternative Title)
  • Archival Version (Subtitle)
Publication Date
2015-03-31
Publication Place
Ann Arbor, Michigan
Publisher
  • Inter-University Consortium for Political and Social Research
Funding Reference
  • United States Department of Health and Human Services. Administration for Children and Families. Office of Planning, Research and Evaluation
Language
English
Free Keywords
Schema: ICPSR
children; curriculum evaluation; early childhood education; emotional development; Head Start; learning; mental health; peer groups; poverty; professional development; teachers; teaching methods
Description
  • Abstract

    Low-income preschool children experience greater risks to their social and emotional development than their more affluent peers. These gaps are observed before children begin their formal schooling, and they remain or increase during the elementary school years. Since social and emotional risks may compromise children's future mental health and peer relationships, addressing them is important in its own right. In addition, social-emotional competence may aid learning: children who have difficulty regulating their emotions and behaviors have been found to receive less instruction, to be less engaged in and less positive about their role as learners, and to have fewer opportunities for learning from peers. The Head Start CARES (Classroom-based Approaches and Resources for Emotion and Social skill promotion) demonstration tests three distinct approaches to enhancing children's social-emotional development on a large scale within the Head Start system - the largest federally funded early-childhood education program in the United States. Conceived and sponsored by the Office of Head Start and the Office of Planning, Research and Evaluation in the Administration for Children and Families within the United States Department of Health and Human Services, the Head Start CARES demonstration was conducted by MDRC, a nonprofit, nonpartisan education and social policy research organization, in collaboration with MEF Associates and several academic partners. The three evidence-based social-emotional interventions selected for the Head Start CARES evaluation included: The Incredible Years Teacher Training Program (IY), Preschool PATHS (PATHS), and a one-year version of Tools of the Mind- Play (Tools). The interventions are referred to as "enhancements" because they enriched and complemented existing practices and curricula used in Head Start classrooms. These enhancements represent three "types" of social-emotional programming. That is, while all three were aimed at children's social-emotional development, they varied in their approach to changing this set of child outcomes by targeting somewhat different teacher practices, because they were built on differing theories about how social and emotional skills develop. Baseline and Follow-up Class-level Impact Analysis Data Files Data included in class-level data files were collected from external observers and teachers through two sources: Classroom Observations and Teacher Self-Surveys. Classroom Observations were conducted by observers blind to treatment status who observed the classrooms participating in the study in four different sessions at Spring Baseline and Pre-K Follow-up. This source includes the Classroom Assessment Scoring System (CLASS) scores and the Adapted Teaching Style Rating Scale (Adapted-TSRS) scores. Teacher Self-Surveys were collected from lead teachers at Spring Baseline and Pre-K Follow-up. This data source includes information on classroom composition as well as teacher demographics, teaching experience, level of stress and depression, and professional relationship with peers and supervisors. Child-level Impact Analysis Data File Data included in this file were collected at Fall Baseline, Pre-K Follow-up and K Follow-up from teachers, children and their parents through three sources: Teacher Reports on Individual Children, Direct Child Assessments and Parent Surveys.Teacher Reports on Individual Children (Teacher Reports) were collected at Fall Baseline, Pre-K Follow-up and K Follow-up. Lead teachers filled out surveys for each child separately, including questions about the child's social skills and behavior, the child's specific knowledge and skills, and the teacher's relationship with the child. Teacher reports were collected for both 4-year-olds and 3-year-olds at Fall Baseline and Pre-K Follow-up, but were not collected for 3-year-olds at K Follow-up. As a cover page to the Teacher Report, a shortened version of the Teacher Self-Survey was collected at K Follow-up and those data are included in this dataset.Direct Child Assessments were conducted at Fall Baseline and Pre-K Follow-up. The dataset comprises data on a set of tasks measuring different skills for each child separately, including social and emotional skills, self-regulation skills and academic skills. Direct Child Assessments were collected for 4-year- olds only.Parent Surveys were collected at Fall Baseline and K Follow-up. The survey was administered by phone and includes information on family demographics, parent-teacher involvement, parent's perception of school safety, child's social skills and behavior problems, parental level of stress and depression, and household composition and income. Parent Surveys were collected for 4-year-olds only. Class-level Implementation Analysis Data File This data file includes data collected from coaches, trainers and teachers on teacher training, classroom-based coaching, and classroom implementation. The data included in this dataset were collected through five separate instruments: (1) Teacher Training Attendance Forms, (2) Coach Weekly Logs, (3) Coach Monthly Fidelity Logs, (4) Trainer Fidelity Logs, and (5) Teacher's View of the Enhancement. Data collected from the first four data sources were collected multiple times during the implementation year while the fifth was collected once at the beginning of the implementation year. The instruments were administered through the Head Start CARES management information system (MIS) with the exception of the Teacher Training Attendance Forms, which were collected on paper. The file also includes some Teacher Self-Survey variables. Data were collected for program group classrooms only. Coach-level Implementation Analysis Data File This data file includes data collected from coaches and trainers on classroom-based coaching. The data included in this dataset were collected through five separate instruments: (1) Teacher Training Attendance Forms, (2) Trainer Supervision Logs, (3) Trainer Logs of Coach Quality, (4) Coach Demographics Survey, and (5) Coach End-of-Year Reflections. The instruments were administered through the Head Start CARES management information system (MIS) with the exception of the Teacher Training Attendance Forms, which were collected on paper. Audiotape Analysis Data File The audiotape data file includes data created using qualitative information (audiotape transcripts of coach-teacher meetings) that can be used to conduct analyses on one of the two components of the professional development model for the Head Start CARES demonstration: classroom-based coaching. Child-level Tracking Data File The child-level tracking data file includes parent-reported data collected in elementary school for children from the Head Start CARES sample. It includes information from parents about children's location and grade, social skills and problem behaviors at home, and receipt of special services.
  • Abstract

    The Head Start CARES (Classroom-based Approaches and Resources for Emotion and Social skill promotion) demonstration tests three distinct approaches to enhancing children's social-emotional development on a large scale within the Head Start system. The three evidence-based social-emotional interventions selected for the Head Start CARES evaluation included: The Incredible Years Teacher Training Program (IY), Preschool PATHS (PATHS), and a one-year version of Tools of the Mind-Play (Tools).
  • Methods

    The Head Start demonstration was conducted over the course of one academic year with 17 Head Start grantees selected to reflect the geographic, racial, and ethnic diversity of the national Head Start population. Grantees were distributed fairly equally across four regions of the country, with four grantees in the Northeast, four in the West, three in the South, and six in the Midwest/Plains states. Also, they were distributed across community action agencies, stand-alone non-profit entities, and large local school systems. Four grantees that participated during the 2009-2010 school year were in Cohort One, and 13 grantees that participated during the 2010-2011 school year were in Cohort Two. Grantees varied on a number of characteristics, including organizational setting, geographic location, urban/rural status, size, and racial or ethnic composition. Within each grantee, groups of 4 or 8 similar centers (in terms of their racial/ethnic composition, part-day/full-day programming, and age classroom composition) were randomly assigned to one of the three enhancements or to a control group that conducted business as usual. In some cases, all centers within a grantee were similar enough in their characteristics that all centers within grantees could be randomly assigned in a single block. However, for some larger grantees, there were differences among groups of centers in racial/ethnic composition, part-day/full-day programming, and/or age classroom composition. The centers in these grantees were grouped into smaller 4- or 8-center random assignment blocks so that all the centers in each block were comparable across these characteristics. A total of 104 centers across 22 blocks were randomly assigned to one of these four groups. Eighteen blocks included four centers in the study, and four blocks included eight centers. Up to six classrooms and an average of 12 children per classroom were included in the study. The preschool sample included 307 classrooms and 3,603 children (2,670 four-year-old children and 933 three-year-old children). For the child-level tracking effort, the study attempted to track 3,588 children: all 4-year-olds that were located in kindergarten (2,655) and the 933 3-year-olds in the preschool sample. Of these children, data was collected on 2,875 at least once during the two-year long-term follow-up period (when the children were in grades 1 to 3).
  • Methods

    ICPSR data undergo a confidentiality review and are altered when necessary to limit the risk of disclosure. ICPSR also routinely creates ready-to-go data files along with setups in the major statistical software formats as well as standard codebooks to accompany the data. In addition to these procedures, ICPSR performed the following processing steps for this data collection: Performed consistency checks.; Created variable labels and/or value labels.; Standardized missing values.; Created online analysis version with question text.; Checked for undocumented or out-of-range codes..
  • Methods

    Presence of Common Scales: Classroom Assessment Scoring System Adapted Teaching Style Rating Scale Woodcock-Johnson III Expressive One-Word Picture Vocabulary Test
  • Methods

    Response Rates: Specific response rates for each collection of each instrument can be found in the codebooks for each dataset. In general, base-line and follow-up impact response rates were > 90 percent, coach-level implementation and child-level impact response rates were > 80 percent and class-level implementation response rates were > 60 percent.
  • Abstract

    Datasets:

    • DS0: Study-Level Files
    • DS1: Baseline Class-level Impact Analysis File
    • DS2: Follow-up Class-level Impact Analysis File
    • DS3: Child-level Impact Analysis File
    • DS4: Class-level Implementation Analysis File
    • DS5: Coach-level Implementation Analysis File
    • DS6: Audiotape Analysis File
    • DS7: Child-level Tracking Data File
Temporal Coverage
  • Time period: 2009--2015
  • 2009 / 2015
  • Collection date: 2009--2015
  • 2009 / 2015
Geographic Coverage
  • United States
Sampled Universe
Head Start teachers, students, and parents Smallest Geographic Unit: State
Sampling
The preschool sample included 307 classrooms and 3,603 children (2,670 four-year-old children and 933 three-year-old children). The study attempted to follow the 2,670 four-year-old children into kindergarten for further data collection. Of these children, 2,599 were tracked to their kindergarten classrooms. The sample of classrooms participating in the audiotape study was not intended to be a representative sample of classrooms. Classrooms were selected from the full set of Cohort 2 sites that represented all three curriculum enhancements: Incredible Years (IY), Preschool PATHS (PATHS), or Tools of the Mind--Play (Tools-Play). A total of 21 coach-teacher pairs from 11 Head Start grantees participated in the effort. The audiotape data are restricted to classrooms with audiotaped recordings at all three time periods. Of the 21 coach-teacher pairs that participated in the effort, 18 submitted complete recordings, producing a total of 54 recorded coach-teacher meetings.
Collection Mode
  • computer-assisted telephone interview (CATI)
  • coded on-site observation
  • face-to-face interview
  • on-site questionnaire
  • web-based survey
Note
2017-03-06 Added updated data and documentation for Child-level Tracking Data File to include an additional School ID variable.2017-02-01 Added data and documentation for Child-level Tracking Data File.2015-07-17 A variable-search function was added to the study home-page, and additional question text was added to the codebooks. Funding institution(s): United States Department of Health and Human Services. Administration for Children and Families. Office of Planning, Research and Evaluation.
Availability
Delivery
One or more files in this study are not available for download due to special restrictions; consult the study documentation to learn more on how to obtain the data.
Alternative Identifiers
  • 35510 (Type: ICPSR Study Number)
Relations
  • Is previous version of
    DOI: 10.3886/ICPSR35510.v1
Publications
  • Bleckman, Johanna, Mancini, Patrizia, Mattera, Shira K.. Understanding and Using the Head Start CARES Data: An Introductory Webinar. Webinar, New York, NY: Child Care & Early Education Research Connections. 2015.
    • ID: https://www.youtube.com/watch?v=q2qb_ilhFwQ (URL)
  • Hsueh, JoAnn, Bangser, Michael, Lowenstein, Amy E., Mattera, Shira K., Morris, Pamela A.. Impacts of Social-Emotional Curricula on Three-Year-Olds: Exploratory Findings from the Head Start CARES Demonstration. OPRE Report 2014-78.Washington, DC: U.S. Administration for Children and Families, Office of Planning, Research and Evaluation. 2014.
    • ID: http://www.acf.hhs.gov/sites/default/files/opre/head_start_cares_3s_report_2014.pdf (URL)
  • Morris, Pamela A., Bangser, Michael, Bierman, Karen L., Castells, Nina, Mattera, Shira K., Raver, C.C.. Impact Findings from the Head Start CARES Demonstration: National Evaluation of Three Approaches to Improving Preschoolers’ Social and Emotional Competence. OPRE Report 2014-44.Washington, DC: U.S. Administration for Children and Families, Office of Planning, Research and Evaluation. 2014.
    • ID: https://www.acf.hhs.gov/sites/default/files/opre/hscares_2014_impact_report.pdf (URL)
  • Mattera, Shira K., Bangser, Michael, Fishman, Mike, Lloyd, Chrishana M.. A First Look at the Head Start CARES Demonstration: Large-scale Implementation of Programs to Improve Children's Social-Emotional Competence. OPRE Report 2013-47.U.S. Administration for Children and Families, Office of Planning, Research and Evaluation. 2013.
    • ID: https://www.acf.hhs.gov/sites/default/files/opre/head_start_cares_implementation_full_report.pdf (URL)
  • Rojas, Natalia, Lloyd, Chrishana M., Mattera, Shira K.. Fidelity and Scaling-Up in the Context of a Social-Emotional Intervention for Early Childhood Education. Society for Research on Educational Effectiveness Spring 2013 Conference.Washington, DC. 2013.
    • ID: https://files.eric.ed.gov/fulltext/ED563186.pdf (URL)
  • Morris, Pamela A.. Head Start CARES (Head Start Classroom-based Approaches and Resources for Emotion and Social skill promotion). MDRC. 2007.
    • ID: https://www.acf.hhs.gov/opre/research/project/head-start-cares-head-start-classroom-based-approaches-and-resources-for (URL)

Update Metadata: 2019-09-04 | Issue Number: 14 | Registration Date: 2015-06-16

Morris, Pamela (2015): Head Start CARES Demonstration: National Evaluation of Three Approaches to Improving Preschoolers' Social and Emotional Competence, 2009-2015. Archival Version. Version: v0. ICPSR - Interuniversity Consortium for Political and Social Research. Dataset. http://doi.org/10.3886/ICPSR35510