An Evaluation of Alignment between French Language National Test and the Common European Framework of Reference for Languages Using Item Mapping

  • Preud Bairaman Educational Measurement and Evaluation, School of Educational Studies, Sukhothai Thammathirat Open University
  • Sungworn Ngudgratoke Educational Measurement and Evaluation, School of Educational Studies, Sukhothai Thammathirat Open University
  • Nalinee Na Nakorn Educational Measurement and Evaluation, School of Educational Studies, Sukhothai Thammathirat Open University

Abstract

Standards-based education has become a crucial issue with which evaluating the learning of French language in Thailand was then required to comply. Since the alignment is the core idea in systematic and standards-based reform, this study aimed to evaluate the alignment between Thailand’s Professional and Academic Aptitude Test in French language (PAT 7.1) and the Common European Framework of Reference for Languages by using item mapping and to study the factors affecting the misalignment between Thailand’s Professional and Academic Aptitude Test in French language (PAT 7.1) and the Common European Framework of Reference for Languages. Variables were composed of contents and cognitive demands. Populations were 100 items of PAT 7.1, 388 grade-12 students (Matthayomsuksa 6) in English-French program (academic year 2017) in 10 schools under the South 2’s Development Center of French language (Le Centre pour le Développement du Français, CDF Hatyai) and 3 qualified panelists. A sample of 163 students were selected using the multistage sampling method. Research tools consisted of a PAT 7.1 test, two alignment matrixes and a set of open-ended questions. Data was analyzed using the proportion, Rasch IRT model, chi-square, percentage and content analysis.

The research revealed that there were 16 items of PAT 7.1 aligning with the Common European Framework of Reference for Languages. Most of them were classified into A2 level and evaluated analysis/investigate skill. Moreover, item mapping result was coherent with that of panelists’ judgement. Three main factors affecting the misalignment were highlighted: the incoherence between item content and standard content, the unmatched levels of cognitive demands and the language usage, including the grammar, in the items that was irrelevant to standard and to students’ language proficiency levels.

Keywords: French language, CEFR, alignment, item mapping

Author Biographies

Sungworn Ngudgratoke, Educational Measurement and Evaluation, School of Educational Studies, Sukhothai Thammathirat Open University

School of Educational Studies

Assistant Professor in Measurement and quantitative methods

Nalinee Na Nakorn, Educational Measurement and Evaluation, School of Educational Studies, Sukhothai Thammathirat Open University

School of Educational Studies

Assistant Professor  in Measurement and educational evaluation

Published
2018-11-29
How to Cite
BAIRAMAN, Preud; NGUDGRATOKE, Sungworn; NA NAKORN, Nalinee. An Evaluation of Alignment between French Language National Test and the Common European Framework of Reference for Languages Using Item Mapping. วารสารวิทยบริการ มหาวิทยาลัยสงขลานครินทร์ | Academic Services Journal, Prince of Songkla University, [S.l.], v. 29, n. 3, p. 155-161, nov. 2018. ISSN 2351-0420. Available at: <https://journal.oas.psu.ac.th/index.php/asj/article/view/1270>. Date accessed: 19 feb. 2026. doi: https://doi.org/10.14456/asj-psu.2018.52.