State-of-the-art of Language Testing and Assessment in Non-formal Education: The Case of English Language Schools in Turkey
Abstract
Purveying insights from a mixed-method research design, this study aims to enlighten the exploitation of the European guidelines in language testing and assessment practices in non-formal educational settings. Accordingly, three non-formal English language schools renowned for quality in Turkey were taken to in-depth analysis in order to offer a general paradigm from a sample of leading professionals on the utilization of the European benchmarks in language testing and assessment practices. The results have yielded that (1) there is a need for a more practical curriculum molded with a real auditing system for the enhancement of the current language testing and assessment practices; (2) there is a request for the validation process for language certificate examinations implemented in non-formal educational settings; (3) there is a demand for cooperation amidst the allies for the standardization process in language testing and assessment practices. The results are laced with some recommendations and implications for language testing and assessment.References
Alderson, J. C. (2007). The CEFR and the need for more research. The Modern Language Journal (MLJ), 91(4), 659–663.
Alderson, J.C., & Banerjee, J. (2008). EALTA’s guidelines for good practice: A test of implementation. Paper presented at the 5th Annual Conference of the European Association for Language Testing and Assessment. Athens, Greece, 8- 11 May, 2008. [On-line: http://www.ealta.eu.org/conference/2008/programme.htm, Retrieved on 15 February, 2017.]
Alderson, J. C. (2010). A survey of aviation English tests. Language Testing, 27(1), 51-72.
Association of Language Testers in Europe (ALTE). (2012). Constitution for the association of language testers in Europe. [On-line: http://www.alte.org/docs/constitution-2012.pdf, Retrieved on 16 June, 2016.]
Banerjee, J. (2004). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the CEF: Section D: Qualitative analysis methods. Strasbourg: Language Policy Division.
Bjornavold, J. (2000). Making learning visible: Identification, assessment and recognition of non-formal learning in Europe. Luxembourg: European Communities.
Coste, D. (2007). Contextualizing uses of the Common European Framework of Reference for Languages. Paper presented at Council of Europe Policy Forum on use of the CEFR, Strasbourg 2007. [On-line: http://www.coe.int/T/DG4/Linguistic/Source/SourceForum07/D-Coste_Contextualise_EN.doc, Retrieved on 25 September, 2018,]
Council of Europe (CoE). (2000). Resolution on the European language portfolio. Adopted at the 20thsession of the Standing conference of the ministers of education of the Council of Europe, Cracow, Poland, 15-17 October, 2000. [On-line: http://culture.coe.int/portfolio, Retrieved on 7 February, 2017.]
Council of Europe (CoE). (2001). Common European framework of reference for languages: Learning, teaching, assessment. Cambridge: Cambridge University Press.
Council of Europe (CoE). (2005). Reference level descriptions for national and regional languages (RLD) – Guide for the production of RLD (Version 2). Strasbourg: Language Policy Division.
Council of Europe (CoE). (2009a). Relating language examinations to the common European framework of reference for languages: Learning, teaching, assessment (CEFR): A manual. Strasbourg: Language Policy Division.
Council of Europe (CoE). (2009b). Relating language examinations to the common European framework of reference for languages: Learning, teaching, assessment (CEFR): Further material on maintaining standards across languages, contexts and administrations by exploiting teacher judgment and IRT scaling. Strasbourg: Language Policy Division.
Council of Europe (CoE). (2011). Manual for language test development and examining: For use with the CEFR. Strasbourg: Language Policy Division.
De Jong, J. H. A. L., & Zheng, Y. (2011). Research Note: Applying EALTA guidelines: A practical case study on Pearson Test of English Academic. London: GB Pearson.
Eckes, T. (2009). Reference Supplement to the preliminary pilot version of the Manual for Relating Language examinations to the CEF: Section H: Many- Facet Rasch Measurement. Strasbourg: Language Policy Division.
Erickson, G., & Figueras, N. (2010). EALTA guidelines for good practice in language testing and assessment: Large scale dissemination days. [Online http://www.ealta.eu.org/documents/archive/GGP_dissemination_report.pdf, Retrieved on 15 July, 2016.]
European Association for Language Testing and Assessment (EALTA). (2006). EALTA guidelines for good practice in language testing and assessment. [On-line: http://www.ealta.eu.org/documents/archive/guidelines/English.pdf, Retrieved on 19 October, 2016.]
Holliday, A. (1992). Tissue rejection and informal disorders in ELT projects: collecting the right information. Applied Linguistics, 13(4), 403-424.
International Language Testing Association (ILTA). (2007). Guidelines for practice in English. [On-line: http://c.ymcdn.com/sites/iltaonline.siteym.com/resource/resmgr/docs/ilta_guidelines.pdf, Retrieved on 20 September 2016.]
Kaftandjieva, F. (2004). Reference supplement to the preliminary pilot version o the manual fo relating language examinations to the CEF: Section B: Standard setting. Strasbourg: Language Policy Division.
Karaboğa, K. (2013, 23 December). İngilizce’ye yılda 100 milyon [100 billion Turkish liras for learning English]. Dünya [The World]. [On-line: https://www.dunya.com/ekonomi/ingilizceye-yilda-100-milyon-haberi-231840, Retrieved on 10 November, 2017.]
Kavaklı, N., & Arslan, S. (2017). Applying EALTA Guidelines as baseline for the foreign language proficiency test in Turkey: The case of YDS. International Journal of Curriculum and Instruction (IJCI), 9(1), 104-118.
Kavaklı, N. (2018). CEFR oriented testing and assessment practices in non-formal English language schools in Turkey. Unpublished PhD Thesis. Ankara: Hacettepe University.
Kavaklı, N., & Arslan, S. (2019). Towards a continuum from know-how to show-how for developing EFL student-teachers’ assessment literacy. International Online Journal of Education and Teaching (IOJET), 6(1), 223-232.
Kavaklı, N., & Mirici, İ. H. (2018). The utilization of the European standards for defining educational assessment: teacher-tester attributes and directors’ control. Selçuk University Journal of Faculty of Letters (SEFAD), 40, 171-190.
Lambert, D., & Lines, D. (2000). Understanding assessment: Purposes, perceptions, practice. London, UK: Routledge Falmer.
Little, D. (2005). The common European framework and the European language portfolio: Involving learners and their judgements in the assessment process. Language Testing, 22(3), 321-336.
Mirici, Ä°. H. (2008). Development and validation process of a European language portfolio model for young learners. Turkish Online Journal of Distance Education (TOJDE), 9(2), 26-34.
Mirici, Ä°. H. (2015). Contemporary ELT practices across Europe. International Journal of Language Academy (IJLA), 3(4), 1-8.
Mirici, İ. H., & Kavaklı, N. (2017). Teaching the CEFR-oriented practices effectively in the MA program of an ELT department in Turkey. International Online Journal of Education and Teaching (IOJET), 4(1), 74-85.
North, B. (2005). Le Cadre européen commun de référence: Introduction. [The Common European framework of reference: Introduction]. Paper presented at the Journée Pédagogique, 15 June, 2005, Paris, France. On-line: http://www.alliance-us.org/dg/ documentupload/cecrBrianNorth.pdf., Retrieved on 9 April 2017.]
Saville, N. (2005). An interview with John Trim at 80. Language Assessment Quarterly, 2(4), 263-288.
Schaerer, R. (2005). European language portfolio: Interim report 2005 with executive summary. Strasbourg: Language Policy Division.
Spöttl, C., Kremmel, B., Holzknecht, F., & Alderson, J. C. (2016). Evaluating the achievements and challenges in reforming a national language exam: The reform team’s perspective. Papers in Language Testing and Assessment, 5(1), 1-22.
Taber, K. S. (2000). Case studies and generalizability: Grounded theory and research in science education. International Journal of Science Education, 22, 469-87.
Toncheva, S., Zlateva, D., & John, P. (2017). Developing as assessment methodology for a universal maritime English proficiency test for deck officers. Paper presented at the 18th Annual General Assembly of the International Association of Maritime Universities (IAMU), 11-13 October, 2017, Varna, Bulgaria. [On-line: https://www.researchgate.net/publication/320419205_Developing_an_assessment_methodology_for_a_universal_Maritime_English_proficiency_test_for_deck_officers, Retrieved on 20 October, 2017.]
Trim, J. L. M. (2005). The role of the Common European Framework of Reference for Languages in teacher training. Lecture delivered during the Ceremony of the 10th Anniversary of the European Centre for Modern Languages of the Council of Europe, 16 September, 2005, Graz, Austria. [On-line: http://www.europarl.europa.eu/RegData/etudes/etudes/join/2013/495871/IPOL-CULT_ET(2013)495871_EN.pdf, Retrieved on 17 November, 2016.]
Valax, P. (2011). The Common European Framework of Reference for Languages: A critical analysis of its impact on a sample of teachers and curricula within and beyond Europe. Unpublished Doctoral Dissertation. University of Waikato, Hamilton, New Zealand.
Verhelst, N. (2004a). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the CEF: section C: Classical test theory. Strasbourg: Language Policy Division.
Verhelst, N. (2004b). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the CEF: section E: Generalizability theory. Strasbourg: Language Policy Division.
Verhelst, N. (2004c). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the CEF: section F: Factor analysis. Strasbourg: Language Policy Division.
Verhelst, N. (2004d). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the CEF: Section G: Item response theory. Strasbourg: Language Policy Division.
Downloads
Published
Issue
Section
License
Submission of an article implies that the work described has not been published previously (except in the form of an abstract or as part of a published lecture or academic thesis), that it is not under consideration for publication elsewhere, that its publication is approved by all authors and tacitly or explicitly by the responsible authorities where the work was carried out, and that, if accepted, will not be published elsewhere in the same form, in English or in any other language, without the written consent of the Publisher. The Editors reserve the right to edit or otherwise alter all contributions, but authors will receive proofs for approval before publication.
Copyrights for articles published in International Journal of Curriculum and Instruction are retained by the authors, with first publication rights granted to the journal. The journal/publisher is not responsible for subsequent uses of the work. It is the author's responsibility to bring an infringement action if so desired by the author.
