Research Reports & Publications
To view Kingsbury Center presentations, please visit our Slideshare page.
| Report Name |
Published |
Author(s) |
|---|---|---|
Student Test-Taking Effort and the Assessment of Student Growth in Evaluating Teacher EffectivenessThis paper was presented at the annual meeting of the National Council on Measurement in Education (NCME) in April, 2013. There is evidence that student effort has significant influence on growth results, and that unusually low levels of student effort may have a significant impact on student growth within a classroom or among students assigned to a teacher.This paper discusses problems related to test validity when students do not exhibit full effort on assessments, overview methods for detecting non-effortful test taking, and describe methods for ameliorating the problems. In addition, the results of the data analyses derived from this study will illustrate both the problems and our proposed solutions. Learn More About the Study |
May 1, 2013 | |
Construct Validity and Measurement Invariance of Computerized Adaptive Testing: Application to Measures of Academic Progress (MAP) Using Confirmatory Factor AnalysisThere are many challenges to providing validity evidence for CAT tests because of its uniqueness compared to fixed form tests. This study, using real data, provides empirical evidence of construct and invariance construct of MAP scales across grades at different academic calendars for 10 different states. Results show theconsistency and reasonableness of interpretation of the MAP RIT scale across grades and academic calendar years for the different states. Learn More About the Study |
April 8, 2013 | |
A Level Playing Field: How College Readiness Standards Change the Accountability GameIn this follow-up to Do High flyers Maintain Their Altitude? Performance Trrends of Top Students, the academic growth of a large sample of students, all of them high achievers within their own schools, were followed over a three-year period. Their achievement scores were matched with their associated probability of being on track to meet ACT college readiness benchmarks. The study yielded several major findings and policy implications. Learn More About the StudyView the Data Gallery |
March 25, 2013 | |
For Whom the Pell Tolls: How Financial Aid Policies Widen the Opportunity GapIn this study, we examined the financial impact of achievement gaps by projecting how student access to state-level merit-basedscholarship funds might vary, based on the estimated performance on the ACT. The findings parallel recent studies that show low-income students qualify for state-level financial aid at lower levels than their more privileged peers. Learn More About the StudyView the Data Gallery |
March 25, 2013 | |
The Impact of School Size on Student Achievement: Evidence from Four StatesKingsbury Center data award recipient Anna Jacob Egalite is a doctoral academy fellow, and her co-author Brian Kisida is a research associate, at the University of Arkansas. They received a data award from to look at student achievement impacts related to school size. |
March 12, 2013 | |
Setting Response Time Thresholds for a CAT Item Pool: The Normative Threshold MethodThis paper was presented at the 2012 National Council on Measurement in Education (NCME) Annual Conference in Vancouver, BC, Canada. Learn More About the Study |
April 27, 2012 | |
Effect of Missing Data in Computerized Adaptive Testing on Accuracy of Item Parameter Estimation: A comparison of NWEA and WINSTEPS Item Parameter Calibration ProceduresThis paper was presented at the 2012 meeting of the American Educational Research Association (AERA) in Vancouver, BC, Canada. Learn More About the Study |
April 26, 2012 | |
Construct Validity and Measurement Invariance of Computerized Adaptive Testing: Application to Measures of Academic Progress (MAP) Using Confirmatory Factor AnalysisThis paper was presented at the 2012 American Educational Research Association (AERA) meeting in Vancouver, BC, Canada. Learn More About the Study |
April 26, 2012 | |
Examine Construct Validity of computerized Adaptive tests in K-12 AssessmentsThis paper was presented at the 2012 National Council on Measurement in Education (NCME) Annual Conference in Vancouver, BC, Canada. Learn More About the Study |
April 26, 2012 | |
An Investigation of Instructional Effects on Student Growth in Mathematics with Repeated Measures Using Computerized-Adaptive TestsThis paper was presented at the 2012 National Council on Measurement in Education (NCME) Annual Conference in Vancouver, BC, Canada. Learn More About the Study |
April 25, 2012 | |
Measuring Growth Toward College Readiness: Using MAP (Measures of Academic Progress) Scores to Predict Success on the ACT Test Benchmark ScoresThis paper was was presented at a poster session at the 2012 meeting of the American Educational Research Association (AERA) in Vancouver, BC. The research establishes college readiness benchmarks through elementary and middle grades in mathematics and reading using ACT as score criteria. This study presents the current findings of a work in progress, whose final goal is a model for predicting college readiness. Learn More About the Study |
April 24, 2012 | |
Model Selection for Equating Testlet-Based Tests in the NEAT Design: An Empirical StudyThis paper was presented at the 2012 National Council on Measurement in Education Conference in Vancouver, BC, Canada. Learn More About the Study |
April 24, 2012 | |
The Teaching Workplace Literature ReviewNWEA is considering a major survey study of the bundle of factors that would increase teachers’ job satisfaction and retention, with a focus on the factors most important to effective teachers—those who have demonstrated student academic growth. As background to this effort, this literature review summarizes what is already known about working conditions that are important for fostering teacher job satisfaction and retention. |
November 14, 2011 | Kingsbury Center |
Kingsbury Center Response to the NEPC Report |
October 28, 2011 | |
Summer Growth Patterns in Gifted StudentsKaren Rambo received a data award from the Kingsbury Center to look at summer growth patterns and to assess the impact of schools on high achievers. |
October 28, 2011 | Karen Rambo |
Does Assessment Selection Matter When Computing Teacher Value-Added Measures?Kingsbury Center data award recipient James Woodworth is a distinguished doctoral fellow at the University of Arkansas. Using data from the Growth Research Database, he analyzed the error variance produced by value added models using different assessments. |
October 14, 2011 | James Woodworth |
Do High Flyers Maintain Their Altitude? Performance Trends of Top StudentsThis study was conducted by Kingsbury Center researchers on behalf of the Thomas B. Fordham Institute, and contains an analysis of the achievement of high-performing students over time to understand which students maintain their "high flying" status over time. p. Using data from an extensive student-level database maintained by the Northwest Evaluation AssociationTM (NWEA) and its Measures of Academic ProgressTM (MAP) assessments, we compared the performance and growth of high achievers to that of their peers over multiple years, examining two groups of students: an elementary/middle school cohort, followed from third through eighth grades; and a middle/high school cohort, followed from sixth through tenth grades. View the Data Gallery |
September 20, 2011 | |
The State of ProficiencyAn update to a 2007 report on proficiency (The Proficiency Illusion), this study looks at differences in the difficulty of proficiency cut scores, by state, grade, and subject. View the Data Gallery |
June 28, 2011 | |
Portland Schools Foundation Ninth Grade CountsStudent Data Report - Outcomes and Participation for Summer 2009 and Participation for Summer 2010 |
May 16, 2011 | |
Using Growth Data for Accountability - ResourcesResources related to John Cronin's 12/9/10 webinar on using growth data for accountability. |
December 9, 2010 | John Cronin |