Archived Information
A Study of Charter Schools: First Year Report - May 1997
Appendix A
Overview of the National Study's Research Design
The National Study is a four-year project designed to address research questions in the following three areas:
- Implementation. What kinds of charter schools are developed in which states? In what ways are they similar to other public schools and in what ways are they different? What types of students attend charter schools, and how do they differ from students in other public schools? What factors influence charter school development and implementation? How do states differ in their approaches to charter schools, and how do charter legislation and policies affect charter schools in that state?
- Impact on students. Do charter schools have a positive impact on student learning? Under what conditions do charter schools improve or not improve student achievement and other aspects of student learning?
- Effect on public education. How do charter schools and charter legislation impact local and state education policy? Are charter schools developing models or reform strategies that can be used by other public schools to improve education for their students? Does the existence of charter schools pressure other schools to reform? What lessons can be learned from the successes and failures of charter schools?
In order to collect and analyze systematic data about these questions, the Study has five interlocking research components:
- Yearly telephone interviews with all operational charter schools. The Study will maintain a database with information about all operational charter schools. During the first year, the Study called all charter schools that were in operation as of January 1996. In subsequent years, we will interview all new charter schools that become operational. (We define operational as providing instruction to students). Annually, the Study will conduct a follow-up telephone interview with all charter schools to update the national database. All charter sites are assured confidentiality for this information. The database, with information removed that might identify any particular charter schools, will be available on a World Wide Web site maintained by the Study.
- Repeated field visits to and data collection at a sample of charter schools and comparison sites. In the first year, the Study chose an unbiased sample of 42 sites (cohort 1) within the five states that had charter schools which were in operation at least one year as of the 1995-96 school year. The total number of charter schools meeting this criteria was 93. Within the five states, the Study selected either all sites in the state or chose charter schools at random within the categories of grade levels served, school size, and whether the schools were newly created or pre-existing schools. This procedure will be followed to select a second cohort of at least 30 charter schools in additional states in which charter schools were operational for at least one year as of the 1996-97 school year. The Study may also add sites in one or more states that had a low number of charter schools meeting the criteria for cohort 1 but that have more schools fulfilling this selection requirement as of the 1996-97 school year. Depending on funding, the Study will select a third cohort of charter schools in 1997-98 in order to include states that have more recently adopted charter legislation. The Study will conduct fieldwork at each of the selected sites. In addition to charter school field sites, the Study will choose and collect data from public school comparison sites that have demographic and other conditions as closely matched as possible to charter schools in the cohort samples. The data collected at all sites include information on student assessment, educational programs, organizational structure and climate, governance and finance, parental and community involvement and support, relations with district and/or charter sponsoring agencies, and factors affecting charter school development and implementation.
- Longitudinal assessment of student achievement in a sample of charter schools and comparison sites. The Study is offering to provide achievement tests for all students at selected grade levels in the cohorts of charter school field sites and comparison sites discussed above. The tests are criterion referenced, developed by teachers, and geared to assess the students' skills, knowledge and problem-solving abilities in language arts and mathematics. They are called level tests because students take a short locator exam to place them at their appropriate academic level and then take a full test suitable to their level. In this approach, students are less likely to be bored and more likely to be challenged; consequently, the tests provide more in-depth information for each child and teachers can better diagnose the students' strengths and weaknesses.The testing will be done with the same pupils over a number of years, and thus provide longitudinal data about each student's progress. The Study trains teachers at Study field sites in test use and analysis of results. The first series of tests with cohort 1 schools is scheduled for winter and spring of the 1996-97 school year. To supplement the student achievement data from these tests, the Study will collect and analyze behavioral indicators and existing methods charter schools use to assess student learning.
- Content analysis of state charter policies and interviews with state officials. Since charter legislation differs dramatically by state and states differ in their administration of charter schools, the Study has and will continue yearly to collect and interpret state charter school laws, administrative policies, and court rulings for all states with charter legislation. For a selected number of states, the Study will interview state level players--including knowledgeable officials and non-governmental influential actors who are pro, con or neutral in regards to charter schools. The purpose of these interviews is two-fold: (1) to identify state-level factors that affect local charter development and implementation, and (2) to broadly assess the possible positive or negative impacts of charter schools on statewide public education policy.
- Intensive fieldwork and data collection at selected charter sites in order to assess effect on public education. Beginning in 1997 and following every year throughout the project's life, the Study will purposively select a subsample of the Study sites in several states to examine the impact of charter schools on local and regional school systems. At each site, the Study will interview district and regional school personnel, community members, and representative interest groups. Team members will also collect news stories and other artifacts that bear on what, if anything, can be discerned about the extent and ways in which charter schools impact public education. This data collection from the ground up will be combined with state level information gathered as discussed above. The field sites for these policy studies will only be in those states for which state-level interviews will be done.
-###-
[Notes]
[Appendix B]