A randomized trial across 19 universities found higher exam scores in STEM classes using instructor-designed AI tools.
Students in applied STEM courses scored higher on proctored exams when instructors introduced AI tools tailored to their classes, compared with classes still waiting for their tools, according to a randomized trial across 19 universities reported in a Nov. 14 preprint.
The research led by Jun Li of the University of Michigan estimated a student-level gain of 0.32 standard deviations, with a 95% confidence interval of 0.06 to 0.59 standard deviations.
The estimate puts the improvement at roughly 33% of the typical spread in scores within a class and leaves uncertainty about the size of the gain. Standardizing scores within each class gave researchers a common scale for comparing results across courses that used different exams.
The preregistered trial involved 7,200 students in 55 applied STEM classes over three semesters, from spring 2025 through spring 2026. The study counted each course-and-instructor pairing as one class.
The experimental part of the exam analysis covered 4,768 students across 44 course offerings. Researchers used results from earlier terms alongside that sample to account for how classes had performed before the rollout.
The exam analysis included only proctored, in-person exams, mostly on paper. The remaining exams used strictly monitored computers or restricted-access computers at university testing centers.
The researchers added that screening rule after preregistration and excluded course offerings where exams could allow AI assistance.
One group introduced course-specific AI tools a term earlier. Researchers measured learning on proctored exams that excluded AI assistance.
Source link







