An Evaluation of Alignment between French Language National Test and the Common European Framework of Reference for Languages Using Item Mapping

Abstract

Standards-based education has become a crucial issue with which evaluating the learning of French language in Thailand was then required to comply. Since the alignment is the core idea in systematic and standards-based reform, this study aimed to evaluate the alignment between Thailand’s Professional and Academic Aptitude Test in French language (PAT 7.1) and the Common European Framework of Reference for Languages by using item mapping and to study the factors affecting the misalignment between Thailand’s Professional and Academic Aptitude Test in French language (PAT 7.1) and the Common European Framework of Reference for Languages. Variables were composed of contents and cognitive demands. Populations were 100 items of PAT 7.1, 388 grade-12 students (Matthayomsuksa 6) in English-French program (academic year 2017) in 10 schools under the South 2’s Development Center of French language (Le Centre pour le Développement du Français, CDF Hatyai) and 3 qualified panelists. A sample of 163 students were selected using the multistage sampling method. Research tools consisted of a PAT 7.1 test, two alignment matrixes and a set of open-ended questions. Data was analyzed using the proportion, Rasch IRT model, chi-square, percentage and content analysis.

The research revealed that there were 16 items of PAT 7.1 aligning with the Common European Framework of Reference for Languages. Most of them were classified into A2 level and evaluated analysis/investigate skill. Moreover, item mapping result was coherent with that of panelists’ judgement. Three main factors affecting the misalignment were highlighted: the incoherence between item content and standard content, the unmatched levels of cognitive demands and the language usage, including the grammar, in the items that was irrelevant to standard and to students’ language proficiency levels.

Keywords: French language, CEFR, alignment, item mapping