Archived Information

A Study of Charter Schools: First Year Report - May 1997

Appendix A

Overview of the National Study's Research Design

The National Study is a four-year project designed to address research questions in the following three areas: In order to collect and analyze systematic data about these questions, the Study has five interlocking research components:
  1. Yearly telephone interviews with all operational charter schools. The Study will maintain a database with information about all operational charter schools. During the first year, the Study called all charter schools that were in operation as of January 1996. In subsequent years, we will interview all new charter schools that become operational. (We define operational as providing instruction to students). Annually, the Study will conduct a follow-up telephone interview with all charter schools to update the national database. All charter sites are assured confidentiality for this information. The database, with information removed that might identify any particular charter schools, will be available on a World Wide Web site maintained by the Study.

  2. Repeated field visits to and data collection at a sample of charter schools and comparison sites. In the first year, the Study chose an unbiased sample of 42 sites (cohort 1) within the five states that had charter schools which were in operation at least one year as of the 1995-96 school year. The total number of charter schools meeting this criteria was 93. Within the five states, the Study selected either all sites in the state or chose charter schools at random within the categories of grade levels served, school size, and whether the schools were newly created or pre-existing schools. This procedure will be followed to select a second cohort of at least 30 charter schools in additional states in which charter schools were operational for at least one year as of the 1996-97 school year. The Study may also add sites in one or more states that had a low number of charter schools meeting the criteria for cohort 1 but that have more schools fulfilling this selection requirement as of the 1996-97 school year. Depending on funding, the Study will select a third cohort of charter schools in 1997-98 in order to include states that have more recently adopted charter legislation. The Study will conduct fieldwork at each of the selected sites. In addition to charter school field sites, the Study will choose and collect data from public school comparison sites that have demographic and other conditions as closely matched as possible to charter schools in the cohort samples. The data collected at all sites include information on student assessment, educational programs, organizational structure and climate, governance and finance, parental and community involvement and support, relations with district and/or charter sponsoring agencies, and factors affecting charter school development and implementation.

  3. Longitudinal assessment of student achievement in a sample of charter schools and comparison sites. The Study is offering to provide achievement tests for all students at selected grade levels in the cohorts of charter school field sites and comparison sites discussed above. The tests are criterion referenced, developed by teachers, and geared to assess the students' skills, knowledge and problem-solving abilities in language arts and mathematics. They are called level tests because students take a short locator exam to place them at their appropriate academic level and then take a full test suitable to their level. In this approach, students are less likely to be bored and more likely to be challenged; consequently, the tests provide more in-depth information for each child and teachers can better diagnose the students' strengths and weaknesses.The testing will be done with the same pupils over a number of years, and thus provide longitudinal data about each student's progress. The Study trains teachers at Study field sites in test use and analysis of results. The first series of tests with cohort 1 schools is scheduled for winter and spring of the 1996-97 school year. To supplement the student achievement data from these tests, the Study will collect and analyze behavioral indicators and existing methods charter schools use to assess student learning.

  4. Content analysis of state charter policies and interviews with state officials. Since charter legislation differs dramatically by state and states differ in their administration of charter schools, the Study has and will continue yearly to collect and interpret state charter school laws, administrative policies, and court rulings for all states with charter legislation. For a selected number of states, the Study will interview state level players--including knowledgeable officials and non-governmental influential actors who are pro, con or neutral in regards to charter schools. The purpose of these interviews is two-fold: (1) to identify state-level factors that affect local charter development and implementation, and (2) to broadly assess the possible positive or negative impacts of charter schools on statewide public education policy.

  5. Intensive fieldwork and data collection at selected charter sites in order to assess effect on public education. Beginning in 1997 and following every year throughout the project's life, the Study will purposively select a subsample of the Study sites in several states to examine the impact of charter schools on local and regional school systems. At each site, the Study will interview district and regional school personnel, community members, and representative interest groups. Team members will also collect news stories and other artifacts that bear on what, if anything, can be discerned about the extent and ways in which charter schools impact public education. This data collection from the ground up will be combined with state level information gathered as discussed above. The field sites for these policy studies will only be in those states for which state-level interviews will be done.

-###-
[Notes] [Table of Contents] [Appendix B]