A r c h i v e d  I n f o r m a t i o n

Assessment of Students Performance April 1997

EXHIBIT 4-12

Sites Having Adopted Various Procedures to Establish Validity and Reliability of Performance Assessment Systems by Level of Initiation
and by Site

 

State Level

District Level

National Level

AZ

KY

MD

NY

OR

VT

PWC

HSD2

NB

NSP

PS
VALIDATION PROCEDURES
Content Validity

X

X

X

    

?

X

X

X

X

X
Consequential Validity  

X

  

?

?

X

          
DEVELOPMENT OF ASSESSMENT TASKS
Teachers, On-Site  

X

  

X

X

X

    

X

X

  
Off-Site  

X

X

  

X

  

X

X

  

X

X
Contract with External Agency

X

X

X

      

X

        
INTERRATER RELIABILITY PROCEDURES

X

X

X

  

X

X

X

  

X

X

X
DEVELOPMENT OF SCORING RUBRICS
Teachers, On-Site      

X

      

X

  

X

  
Off-Site  

X

X

  

X

X

  

X

X

X

X
Contract with External Agency

X

X

X

      

X

        
SCORING PROCEDURES
Teachers, On-Site  

X

  

X

X

X

  

X

X

X

X
Off-Site

X

X

    

X

X

X

X

  

X

X
Off-Site, with Teachers

X

  

X

              

X

EXHIBIT 4-12 (Continued)

  School Level

CM

PE

NB

TH

AC

NE
INTERRATER RELIABILITY PROCEDURES  

*

x

R

   
VALIDATION PROCEDURES
Content Validity  

*

        
Consequential Validity            
Other            

*The assessment in use at Park Elementary has been evaluated in California. However, the validity at Park Elementary (or in New York City) has not been determined.

R= The raters come to an agreement on what score to assign to the students, but this moderation technique is not tied to any external criteria.

   
Cell Key: Site Key:
   
x=present PWC=Prince William County
?=unclear HSD2=Harrison School District 2
  SB=South Brunswick
  CM=Cooper Middle
  PE =Park Elementary
  NB=Ni?os Bonitos Elementary
  TH=Thoreau High
  AC=Ann Chester Elementary
  NE=Noakes Elementary
  NSP=New Standards Project
  PS=Pacesetter