Jamie Dunlea, Neus Figueras: Replicating Results from a CEFR Test Comparison Project Across Continents
31 Replicating Results from a CEFR Test Comparison Project Across Continents Jamie Dunlea1 Society for Testing English Proficiency Neus Figueras2 Departament d’Educació, Generalitat de Catalunya This chapter describes a collaborative project to validate the results of test-centered standard setting carried out in Japan. The study is part of a long-term project investigating the relationship between the EIKEN tests, a seven-level suite of EFL tests in Japan, and the CEFR. As this project demonstrates, the CEFR is being used as a common frame of reference in increasingly diverse contexts. To validate a claim of a link between a test and the CEFR, we need to rephrase the often quoted question “Is my B1 your B1?” to ask explicitly “Is my B1 test still B1 when evaluated by different judges in different educational contexts?” To help answer this question, standard setting for one of the EIKEN tests was replicated in a European context employing the Contrasting Groups procedure, an examinee- centered standard-setting method. Major standard-setting projects are expensive and time- consuming, and this is one reason why the constant call for replication is so little heeded. However, this project demonstrates that through collaboration and cooperation, a relatively small-scale validation study can provide important information to add insight and strengthen the validity of any claims made from standard setting. Key Words: CEFR, standard setting, Contrasting Groups method, validity 1. Introduction The focus of this chapter is a relatively small-scale project undertaken to provide validity evidence in support of a much larger and comprehensive...
You are not authenticated to view the full text of this chapter or article.
This site requires a subscription or purchase to access the full text of books or journals.
Do you have any questions? Contact us.Or login to access all content.