TY - JOUR
T1 - How many questions should I answer? Using bias profiles to estimate optimal bias and maximum score on formula-scored tests
AU - Higham, P A
AU - Arnold, Michelle Marie
PY - 2007
Y1 - 2007
N2 - To maximise multiple choice test scores under formula scoring, students must be able to monitor their knowledge level, reporting correct answers and withholding incorrect ones. Importantly though, neither metacognitive monitoring nor optimal criterion setting has received much attention in the formula-scoring literature. The present research examined the role that both these parameters have on obtained test score. Students wrote three exams under formula-scoring rules, and from these data, we created bias profiles using methodology developed by Higham ( 2007), which allowed us to estimate the optimal number of questions that students needed to answer to maximise their scores. The results indicated that higher scoring students monitored their knowledge best, but that all students tended to guess too often, lowering their test scores. This conservatism maintained despite feedback from previous tests. The results also showed that monitoring is a stable participant skill that generalises across tests.
AB - To maximise multiple choice test scores under formula scoring, students must be able to monitor their knowledge level, reporting correct answers and withholding incorrect ones. Importantly though, neither metacognitive monitoring nor optimal criterion setting has received much attention in the formula-scoring literature. The present research examined the role that both these parameters have on obtained test score. Students wrote three exams under formula-scoring rules, and from these data, we created bias profiles using methodology developed by Higham ( 2007), which allowed us to estimate the optimal number of questions that students needed to answer to maximise their scores. The results indicated that higher scoring students monitored their knowledge best, but that all students tended to guess too often, lowering their test scores. This conservatism maintained despite feedback from previous tests. The results also showed that monitoring is a stable participant skill that generalises across tests.
KW - MULTIPLE-CHOICE TESTS
KW - STRATEGIC REGULATION
KW - MEMORY ACCURACY
KW - NUMBER-RIGHT
KW - PERFORMANCE
UR - http://www.scopus.com/inward/record.url?scp=34347398223&partnerID=8YFLogxK
U2 - 10.1080/09541440701326121
DO - 10.1080/09541440701326121
M3 - Article
SN - 0954-1446
VL - 19
SP - 718
EP - 742
JO - European Journal of Cognitive Psychology
JF - European Journal of Cognitive Psychology
ER -