当前位置: 首页 > 学术活动 > 正文
Innovative Methods of Integrating Multi-Modal Data for Assessing and Detecting Aberrant Testing Behaviors in Technology-enhanced Innovative Assessments
时间:2022年12月14日 22:10 点击数:

报告人:Kaiwen Man

报告地点:腾讯会议ID:384-438-849

报告时间:2022年12月15日星期四9:00-10:00

邀请人:陆婧

报告摘要:

Many important high-stakes decisions—college admission, academic performance evaluation, and even job promotion—depend on accurate and reliable scores from valid large-scale assessments. However, test takers sometimes behave aberrantly (e.g., cheating and guessing), which can undermine the effectiveness of such assessments in yielding accurate, precise information of examinees’ performances. Given this context, the purpose of this research is to create, develop, investigate, and test new statistical approaches that would jointly integrate bio-information (i.e., data) collected from eye-tracking machines with item responses and response time data, which later could be used to detect fraudulent testing behaviors in large-scale testing scenarios. In the current study, three negative binomial models will be introduced for modeling visual fixation counts of test takers solving a set of items. Also, a trivariate joint modeling approach will be introduced that integrates item responses, reaction time and visual fixation counts. This joint model is a cast as a multilevel model in which the structural relationship among the responding accuracy, the working speed and the attention would be manifested. Finally, extensions of using these models for aberrant behavior detections would be discussed. A Markov chain Monte Carlo estimation method is implemented for parameter estimation.

主讲人简介:

Dr. Kaiwen Man was appointed as an Assistant Professor in the Department of Educational Studies in Psychology, Research Methodology, and Counseling at the University of Alabama. Also, Kaiwen has held many positions as Researchers including at the Association of American Medical College, at the Educational Testing Service, and at the Charted Financial Analyst. His research explores questions on the boundaries and interactions of the educational statistics, biometrics, and behavioral research literature with particular attention to models for eye-tracking data, responding process data, Bayesian statistics, and data mining. His works has been published in many peer-reviewed flagship quantitative journals.Moreover, He received the 2022 Brend H. Loyd outstanding dissertation award from National Council on Measurement in Education (NCME). His projects have been externally-funded by the ETS Harold Gulliksen Psychometric Research Fellowship program and the Institute of Education Science.

©2019 东北师范大学数学与统计学院 版权所有

地址:吉林省长春市人民大街5268号 邮编:130024 电话:0431-85099589 传真:0431-85098237