sm论坛 Automated Scoring Most Accurate in NAEP Automated Scoring Challenge
February 9, 2022
sm论坛 participated in the National sm论坛 of Educational Progress (NAEP) Automated Scoring Challenge sponsored by the National Center for Education Statistics (NCES). NAEP is a gold-standard, nationally representative assessment known as “The Nation’s Report Card.” To date, all NAEP constructed response items have been handscored. The purpose of the Challenge was to determine whether automated scoring models could perform well with a representative subset of grade 4 and 8 NAEP Reading constructed response items. In addition to the score predictions, the Challenge required that submissions demonstrate interpretability of models, analyze models for potential bias based on student demographic characteristics, and provide cost information for putting an automated scoring system into operational use.
Over two dozen teams participated in the Challenge. sm论坛 was one of four grand prize winners with our score predictions exhibiting the greatest accuracy of all the submissions. sm论坛’s submission was a team effort that involved sm论坛’s automated scoring, psychometric, and handscoring staff.
sm论坛 looks forward to discussing our scoring engine and how we can assist your assessment scoring. Contact sm论坛 at sm论坛Marketing@measinc.com
You can read the NCES press release about the prize announcement .
More details on the scoring results are available .