Show Less

Collaboration in Language Testing and Assessment

Series:

Dina Tsagari and Ildikó Csépes

The Guidelines for Good Practice of the European Association for Language Testing and Assessment (EALTA) stress the importance of collaboration between all parties involved in the process of developing instruments, activities and programmes for testing and assessment. Collaboration is considered to be as important as validity and reliability, providing a crucial prerequisite for responsibility and respect for students. The papers, covering a range of topics that consider both realities and prospects of collaboration, were originally presented at EALTA conferences from 2008 to 2010.

Prices

Show Summary Details
Restricted access

Jamie Dunlea, Neus Figueras: Replicating Results from a CEFR Test Comparison Project Across Continents

Extract

31 Replicating Results from a CEFR Test Comparison Project Across Continents Jamie Dunlea1 Society for Testing English Proficiency Neus Figueras2 Departament d’Educació, Generalitat de Catalunya This chapter describes a collaborative project to validate the results of test-centered standard setting carried out in Japan. The study is part of a long-term project investigating the relationship between the EIKEN tests, a seven-level suite of EFL tests in Japan, and the CEFR. As this project demonstrates, the CEFR is being used as a common frame of reference in increasingly diverse contexts. To validate a claim of a link between a test and the CEFR, we need to rephrase the often quoted question “Is my B1 your B1?” to ask explicitly “Is my B1 test still B1 when evaluated by different judges in different educational contexts?” To help answer this question, standard setting for one of the EIKEN tests was replicated in a European context employing the Contrasting Groups procedure, an examinee- centered standard-setting method. Major standard-setting projects are expensive and time- consuming, and this is one reason why the constant call for replication is so little heeded. However, this project demonstrates that through collaboration and cooperation, a relatively small-scale validation study can provide important information to add insight and strengthen the validity of any claims made from standard setting. Key Words: CEFR, standard setting, Contrasting Groups method, validity 1. Introduction The focus of this chapter is a relatively small-scale project undertaken to provide validity evidence in support of a much larger and comprehensive...

You are not authenticated to view the full text of this chapter or article.

This site requires a subscription or purchase to access the full text of books or journals.

Do you have any questions? Contact us.

Or login to access all content.