Issues in aligning assessments to the Common European Framework of Reference
##plugins.themes.bootstrap3.article.main##
Resum
Autor/s
Spiros Papageorgiou
Educational Testing Service, MI, USA
ABSTRACT
One of the main aims of the Common European Framework of Reference is to help providers and users of assessments “describe the levels of proficiency required by existing standards, tests and examinations in order to facilitate comparisons between different systems of qualifications” (Council of Europe 2001: 21). Providers of language assessments both inside and outside Europe follow various methodologies to align their assessments with the CEFR levels, as several case studies show (Figueras and Noijons 2009; Martyniuk 2010). This paper discusses the use of the CEFR in the field of language assessment, focusing in particular on issues related to alignment. The paper presents the types of validity evidence that should be accumulated to support an alignment claim and concludes with directions for future research in order to further enhance our understanding of using the CEFR for the design of assessments and the interpretation of assessment results.
Descàrregues
##plugins.themes.bootstrap3.article.details##
Referències
Alderson, J. C. 2005a. Diagnosing foreign language proficiency: The interface between learning and assessment. London: Continuum.
Alderson, J. C. 2005b. Editorial. Language Testing, 22(3), 257-260.
Alderson, J. C. 2007. The CEFR and the need for more research. The Modern Language Journal, 91(4), 659-663.
Alderson, J. C., Figueras, N., Kuijper, H., Nold, G., Takala, S., and Tardieu, C. 2006. Analysing tests of reading and listening in relation to the Common European Framework of Reference: The experience of the Dutch CEFR Construct Project. Language Assessment Quarterly, 3(1), 3–30.
Alderson, J. C., and Huhta, A. 2005. The development of a suite of computer-based diagnostic tests based on the Common European Framework. Language Testing, 22(3), 301-320.
Buckendahl, C. W. 2005. Guest editor's introduction: Qualitative inquiries of participants' experiences with standard setting. Applied Measurement in Education, 18(3), 219-221.
Cizek, G. J., and Bunch, M. 2007. Standard setting: A guide to establishing and evaluating performance standards on tests. London: Sage Publications.
Council of Europe. 2001. Common European Framework of Reference for Languages: Learning, teaching, assessment. Cambridge: Cambridge University Press.
Council of Europe. 2009. Relating language examinations to the Common European Framework of Reference for Languages: Learning, teaching, assessment. A Manual. Retrieved 15/02/2009, from http://www.coe.int/t/dg4/linguistic/manuel1_en.asp
Deville, C., and Chalhoub-Deville, M. 2011. Accountability-assessment under No Child Left Behind: Agenda, practice, and future. Language Testing, 28(3), 307- 321.
Figueras, N., and Noijons, J. (Eds.). 2009. Linking to the CEFR levels: Research perspectives. Arnhem: CITO.
Fulcher, G. 2004. Deluded by artifices? The Common European Framework and harmonization. Language Assessment Quarterly, 1(4), 253-266.
Garcia Gomez, P., Noah, A., Schedl, M., Wright, C., and Yolkut, A. 2007. Proficiency descriptors based on a scale-anchoring study of the new TOEFL iBT reading test. Language Testing, 24(3), 417-444.
Hambleton, R. K. 2001. Setting performance standards on educational assessments and criteria for evaluating the process. In G. J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives (pp. 89 -116). Mahwah, N.J.: Lawrence Erlbaum Associates.
Hambleton, R. K., and Pitoniak, M. J. 2006. Setting performance standards. In R. L. Brennan (Ed.), Educational Measurement (4th ed., pp. 433-470). Westport, CT: Praeger Publishers.
Hasselgreen, A. 2005. Assessing the language of young learners. Language Testing, 22(3), 337-354.
Kane, M. 1994. Validating the Performance Standards Associated with Passing Scores. Review of Educational Research, 64(3), 425-461.
Kane, M. 2012. Validating score interpretations and uses. Language Testing, 29(1), 3-17.
Kantarcioglu, E., and Papageorgiou, S. 2011. Benchmarking and standards in language tests. In B. O' Sullivan (Ed.), Language Testing: Theories and Practices (pp. 94-110). Basingstoke: Palgrave.
Kantarcioglu, E., Thomas, C., O'Dwyer, J., and O' Sullivan, B. 2010. Benchmarking a high-stakes proficiency exam: the COPE linking project. In W. Martyniuk (Ed.), Relating language examinations to the Common European Framework of Reference for Languages: Case studies and reflections on the use of the Council of Europe’s draft manual (pp. 102-116).
Linacre, J. M. 1994. Many-facet Rasch measurement (2nd ed.). Chicago: MESA Press.
Little, D. 2006. The Common European Framework of Reference for Languages: Content, purpose, origin, reception and impact. Language Teaching, 39(3), 167- 190.
Martyniuk, W. (Ed.). 2010. Relating language examinations to the Common European Framework of Reference for Languages: Case studies and reflections on the use of the Council of Europe’s draft manual. Cambridge: Cambridge University Press.
North, B. 2000. The development of a common framework scale of language proficiency. New York: Peter Lang.
North, B., and Schneider, G. 1998. Scaling descriptors for language proficiency scales. Language Testing, 15(2), 217-262.
Papageorgiou, S. 2010a. Investigating the decision-making process of standard setting participants. Language Testing, 27(2), 261-282.
Papageorgiou, S. 2010b. Setting cut scores on the Common European Framework of Reference for the Michigan English Test. (Technical Report). Ann Arbor: University of Michigan. Retrieved 09/09/2011, from http://www.cambridgemichigan.org/sites/default/files/resources/MET_Standard Setting.pdf.
Plake, B. S. 2008. Standard setters: Stand up and take a stand! Educational measurement: Issues and Practice, 27(1), 3-9.
Shohamy, E., and McNamara, T. 2009. Language tests for citizenship, immigration, and asylum. Language Assessment Quarterly, 6(1), 1-5.
Tannenbaum, R. J., and Katz, I. R. 2013. Standard setting. In K. F. Geisinger (Ed.), APA handbook of testing and assessment in psychology: Vol 3. Testing and assessment in school psychology and education (pp. 455-477). Washington, DC: American Psychological Association.
Van Ek, J. A., and Trim, J. L. M. 1991. Waystage 1990. Cambridge: Cambridge University Press.
Van Ek, J. A., and Trim, J. L. M. 1998. Threshold 1990. Cambridge: Cambridge University Press.
Van Ek, J. A., and Trim, J. L. M. 2001. Vantage. Cambridge: Cambridge University Press.
Webb, N. L. 2007. Issues related to judging the alignment of curriculum standards and assessments. Applied Measurement in Education, 20(1), 7-25.
Wilkins, D. A. 1976. Notional syllabuses. Oxford: Oxford University Press.
Zieky, M. J., and Perie, M. 2006. A primer on setting cutscores on tests of educational achievement. Retrieved 08/08/2011, from http://www.ets.org/Media/Research/pdf/Cut_Scores_Primer.pdf