8. Learner Achievement 311
8 Learner Achievement In this study, it was important to check that the item difficulty estimates arrived at through the analysis of the survey questionnaires produced, with adjustment for rater severity, sensible estimates for person ability. Firstly, having videos to look at, and having other information about learners (length of study, tests results) enabled a check to be made on the plausibility of the results of the analysis of the items. Secondly, since the range on the logit scale for conference data accounted for by the differences in severity of untrained raters was about equal to the range accounted for by the items (7 logits as compared to 8 logits) it was apparent that following common practice with scales of language proficiency, potential raters would benefit from being able to see calibrated samples on a video showing what level of proficiency was described by the words in the descriptors. In other words, the ability estimates for the video samples offered not only a point of refer- ence during the analysis process, but also the potential to produce a stan- dardisation video for teacher training in relation to the final scale. Finally, the aim of the Swiss Framework project, for which this study was the meth- odological pilot, was to estimate the range of achievement at cross-over points between educational sectors and provide suitable descriptors of lan- guage proficiency as objectives. It was sensible to check that the methodol- ogy, or an adaptation of it, was going to provide this. Decisions...
You are not authenticated to view the full text of this chapter or article.
This site requires a subscription or purchase to access the full text of books or journals.
Do you have any questions? Contact us.Or login to access all content.