Advisory Committee on Head Start Research and Evaluation

An independent panel of experts was convened to review and make recommendations on the design for a national study on the impact of Head Start, and to monitor and apprise the Secretary on the progress of subsequent research and its impact on Head Start programs.

Evaluating Head Start: A Recommended Framework
The Advisory Committee held a series of meetings in 1999 to fulfill the first phase of its charge. A report was issued in November 1999 summarizing the deliberations of the committee and setting forth its recommendations for a study or series of studies that provide a national analysis of the impact of Head Start.

Head Start's reauthorization in 1998 provides specific guidance about how Congress envisions this research. For example, the legislation calls for research that uses rigorous methodological designs and techniques (based on the recommendations of the advisory group), including longitudinal designs, control groups, nationally recognized standardized measures, and random selection and assignment, as appropriate. The legislation also states that the research shall include comparison of individuals who participate in Head Start programs with control groups (including those who participate in other early childhood programs and those who do not participate in any other early childhood program). Outcomes are to be measured at three points in time: (1) on the dates participants leave Head Start programs; (2) at the end of kindergarten; and (3) at the end of first grade.

The Advisory Committee concluded that a study or set of studies on the impact of Head Start must address two key questions: (1) What difference does Head Start make in the development of the nation's lowest-income children?; and (2) Under what circumstances does Head Start work best, and for what children?

In addition, the committee believed strongly that the research design must be both credible – providing scientifically convincing and persuasive evidence to Congress, the research community, program staff, and parents – and feasible – capable of being implemented in the real world by researchers working in close partnership with Head Start programs.

The 1998 Head Start reauthorizing legislation requires a report by 2003. Because the law and the committee support the follow-up of children through at least the end of first grade, the committee estimated that new research reports would be available in approximately 2006. However, reports from studies currently underway will provide policy makers with useful, evaluative information by 2003.

Next Steps
The Advisory Committee on Head Start Research and Evaluation believes that the framework outlined in its report represents the best strategy for evaluating the impact of Head Start on children. At the same time, the committee believes that several key next steps are critical to translating this strategy into a credible, powerful, and feasible study or set of studies. In particular, the committee urges Secretary Shalala, the research community, and the Head Start community to commit to the following steps:

• Demonstrate clear leadership and commitment to the rigorous evaluation of Head Start, at all levels of the Department of Health and Human Services and the Head Start community;
• Ensure true partnership between researchers and the Head Start community, and involve the Head Start community from the earliest phases of the design;
• Conduct an initial feasibility study or set of activities to collect additional information that is essential to the detailed planning and refinement of the design; and
• Pay close attention to the ongoing implementation of the research, including ensuring several opportunities to review the design and modify it where appropriate.