|
|
A r c h i v e d I n f o r m a t i o nWhat Really Matters in American Education (September 23, 1997)Impact of Vouchers on SchoolingA voucher program which served a substantial number of public school students would suffer from serious implementation problems related to private schools' capacity and mission, and would violate basic principles of equity and a quality education for all students. Specifically:
When a school is failing, providing an escape hatch for a few students will do nothing to improve the quality of education for the majority of students who remain in that school. Indeed, vouchers could hasten the deterioration of the public school system by creating a two-tier educational system in which the motivated, pro-active families and students -- those who have the potential to make the school system better -- would attend private schools and the less involved families and students would attend the public schools. Instead of giving a few students a way out, we need to give all students a way up by improving the quality of all schools.
Impact of Choice And School Type on Student AchievementIn addition to the negative effects of a voucher program on schooling, there are also basic, unanswered questions about the benefits of vouchers and the comparative advantage of private schools for student learning. A growing research base enables us to examine the impact of choice and school type on student achievement. Although they come from different perspectives and may arrive at different conclusions, these studies do share some common themes:
Descriptions of studies that support these themes follow. Impact of Private and Public School Choice Programs on Student AchievementResearch on the impact of existing private school voucher programs has not demonstrated substantial achievement benefits for these programs. In fact, most differences between performance in public and private schools can be explained by the family background of the students (i.e., family income, parents' educational attainment). [Coleman, Hoffer, and Kilgore, High School Achievement: Public, Catholic and Private Schools Compared, 1982] Even when studies control for these factors, they probably still overstate achievement differences because they usually cannot control for "self-selection bias" -- the fact that parents and students who choose to attend schools other than their neighborhood school may have higher motivation and place a higher priority on education than similar families who do not exercise choice.Three separate evaluations of the longest-running publicly-funded voucher program (in Milwaukee) found vastly different results. The first evaluation found voucher students' achievement did not improve significantly from their previous achievement in public schools [Witte et al., Fourth-Year Report: Milwaukee Parental Choice Program, 1994], but a second evaluation of the same data did find evidence that the Milwaukee voucher program had a substantial positive impact on the achievement of students who remained in the program for 3-4 years [Greene, Peterson, and Du, "The Effectiveness of School Choice in Milwaukee: A Secondary Analysis of Data from the Program's Evaluation," 1996]. This second analysis, however, has serious methodological flaws, including the attrition of 85-95 percent of voucher students in the two years in which significant results were found, and a failure to account for student family background and prior achievement. Yet a third analysis [Rouse, "Private School Vouchers and Student Achievement: An Evaluation of the Milwaukee Parental Choice Program," 1997] repeated Greene, et al.'s analysis, and found that voucher recipients did significantly outperform non-enrolled voucher program applicants and a random sample of Milwaukee public school students in math, but did not in reading. These conflicting results provide more of a lesson in the art of statistics than in the effectiveness of voucher programs. The one clear implication of these studies is that the impact of voucher programs on student achievement remains unproven. In Cleveland, the voucher program has only been in existence since the Fall of 1996, and no systematic research on the impact of the program on student achievement is yet available. The Ohio Department of Education is currently sponsoring an Indiana University evaluation of third-graders in the Cleveland voucher program, and a first-year report is expected in late September of this year. However, a recent, well-publicized Harvard press release on the achievement gains of Cleveland voucher students has been touted as evidence of the benefits of voucher programs. [Harvard University, "Gains in Test Scores in the Cleveland Voucher Program Found," 1997] This analysis, conducted by Paul Peterson and funded by the Olin Foundation, claims that students enrolled in two schools in the Cleveland program have realized "moderately large" gains in reading and "even more substantial" gains in math. However, even this analysis concedes that these academic results are mixed, with language scores declining by 5 percentage points overall, and declining by 19 percent among first graders. More importantly, this analysis is in no way a representation of the effectiveness of the Cleveland voucher program, as it is based on only 15 percent of participating students who are enrolled in uniquely operated, resource-intensive schools, and it suffers from severe methodological problems.(3) Lastly, a Hudson Institute study [Weinschrott and Kilgore, "Educational Choice Charitable Trust: An Experiment in School Choice," 1996] of the privately-funded voucher program in Indianapolis found that the voucher students performed "as well as [public school] students in the earlier grades and seem to be doing better in the middle-school grades." However, this appears to be an overly generous characterization of their data, which showed that the voucher students' average test scores were below those of public school students in grade 2, about the same in grades 3 and 6, and higher only in grade 8. An analysis of 1991 International Assessment of Educational Progress data in 16 industrialized nations provides international evidence showing that private schools do not have significantly higher student achievement than public schools after controlling for student background. [Bishop, "Nerd Harassment, Incentives, School Priorities and Learning," 1996] This study found that, after controlling for family background, independent schools did not have higher math and science achievement (for 13-year-olds) than public schools and religiously-controlled schools had significantly lower achievement levels. In Canada, where there is no constitutional prohibition against public subsidies of religious schools and 20 percent of the schools are religiously controlled, students at religious schools scored 3.9 to 4.5 points lower on science and math tests than public school students. Some research indicates that public schools of choice show as large a benefit (if not larger) than private schools in producing better student achievement. For example, a recent analysis of data from the National Educational Longitudinal Survey [Gamoran, "Student Achievement in Public Magnet, Public Comprehensive, and Private City High Schools," Educational Evaluation and Policy Analysis, 1996] found that magnet schools were more effective than comprehensive public high schools at raising the proficiency of students in science, reading, and social studies, while secular private schools did not offer any advantage, after controlling for pre-existing differences among students.
Impact of Course-taking and Standards on Student AchievementThe choice of courses taken has been shown to have a direct connection to student achievement. As Figure 1 depicts (Figure 1, 10,350 bytes), an analysis of National Educational Longitudinal Survey (NELS) data suggests that the mathematics courses students take in high school are more important for achievement that the type of high school attended. While recognizing that a great deal of diversity exists among public and private schools, it is useful to note that when course-taking patterns are accounted for, the mathematics achievement of students in both categories of school is very similar. Public and private school students who had taken the same mathematics courses were almost equally likely to score at the highest achievement level on the NELS twelfth-grade mathematics achievement test. This was also true for low-income public and private school students. Additionally, among both public and private school students of all incomes, students who had taken more rigorous mathematics courses were much more likely to score at the highest achievement level.A growing body of evidence demonstrates that public school reform efforts like challenging standards and rigorous course-taking can improve achievement for the majority of students who are in the public schools. States and local communities that have set more challenging standards are seeing substantial gains in student achievement. For example:
Foot Notes: 3. Among the problems with the Peterson analysis are: (1) it does not compare the gains of these voucher students to their counterparts in the Cleveland public schools; (2) it does not control for the family background or prior achievement of the voucher students; (3) it is based on the results of an old, invalid form of the California Achievement Test; (4) it lumps together results for students in grades K through 3, suggesting that differences among grades are being masked; and (5) the researchers tested the voucher students within the same school year (fall and spring), an approach that has been widely rejected by test experts as producing artificially positive achievement gains.
-###-
Last Updated -- September 23, 1997, (pjk) |