Analysis of a Tailor-Made Language Assessment Course: Perspectives from Course Participants and Instructors: Perspectives from Course Participants and Instructors

Frank Giraldo; Angela Patricia Velásquez Hoyos; Luis Herney Villegas López

Autores

Frank Giraldo Foreign Languages Department of Universidad de Caldas in Manizales, Colombia
Angela Patricia Velásquez Hoyos Foreign Languages Department of Universidad de Caldas in Manizales, Colombia
Luis Herney Villegas López Foreign Languages Department of Universidad de Caldas in Manizales, Colombia

Palavras-chave:

assessment literacy, language assessment, language assessment literacy, teacher learning, teachers’ professional development

Resumo

In the field of language assessment, particularly language assessment literacy (LAL), there is a current need and call to advance pedagogies that engage teachers in language assessment training. As a possible contribution to this field, in this research article, we report on the design and impact of a language assessment course tailored for the specific contextual needs of five Colombian English language teachers. We collected data from teachers and course instructors through a multi-method approach involving five data collection instruments: non-participant observations, course instructors’ reflective logs, participants’ learning artifacts and reflective logs, and an individual interview. Upon data analysis, we found that the course contributed to teachers’ contextual knowledge and practice in language assessment. Additionally, we highlight core course features (tasks, materials, and interactive reflection) and teachers’ attitudes (active participation, peer feedback, and collegiality) that together formed a local LAL pedagogy. Based on these findings, we share conclusions and recommendations for context-sensitive LAL courses for language teachers.

Downloads

Os dados de download ainda não estão disponíveis.

Biografia do Autor

Angela Patricia Velásquez Hoyos, Foreign Languages Department of Universidad de Caldas in Manizales, Colombia

Full-time professor at the Department of Foreign Languages of Universidad de Caldas. Her research interests are critical perspectives in English language teaching, material design, interculturality, and English language methodologies.
Luis Herney Villegas López, Foreign Languages Department of Universidad de Caldas in Manizales, Colombia

Professor of English at the Department of Foreign Languages of Universidad de Caldas. His research interests are critical teaching English to Students with special educational needs, international Exams, and assessment.

Referências

ARIAS, C.; MATURANA, L.; RESTREPO, M. Evaluación de los aprendizajes en lenguas extranjeras: hacia prácticas justas y democráticas. Lenguaje, Cali, v. 40, n. 1, p. 99-126, 2012.

BACHMAN, L.; PALMER, A. Language Testing in Practice: Designing and Developing Useful Language Tests. Oxford: Oxford University Press, 1996.

BAKER, B.; RICHES, C. The Development of EFL Examinations in Haiti: Collaboration and Language Assessment Literacy Development. Language Testing, v. 35, n. 4, p. 557-581, 2018.

BAKER, B.; TAYLOR, L. (ed.). Language Assessment Literacy and Competence: Case Studies from Around the World. Cambridge: Cambridge University Press & Assessment, 2024.

BRAUN, V.; CLARKE, V. Using Thematic Analysis in Psychology. Qualitative Research in Psychology, v. 3, n. 2, p. 77-101, 2006.

CÁRDENAS, M.; GONZÁLEZ, A.; ÁLVAREZ, A. El desarrollo profesional de los docentes de inglés en ejercicio: algunas consideraciones conceptuales para Colombia. Folios, Bogotá, n. 31, p. 49-67, 2010.

FREEMAN, D.; JOHNSON, K. Reconceptualizing the Knowledge-Base of Language Teacher Education. TESOL Quarterly, v. 32, n. 3, p. 397-417, 1998.

FULCHER, G. Assessment Literacy for the Language Classroom. Language Assessment Quarterly, v. 9, n. 2, p. 113-132, 2012.

FULCHER, G. Operationalizing Assessment Literacy. In: TSAGARI, D. (ed.). Language Assessment Literacy: From Theory to Practice. Newcastle upon Tyne: Cambridge Scholars, 2020. p. 8-28.

GAN, L.; LAM, R. A Review on Language Assessment Literacy: Trends, Foci and Contributions. Language Assessment Quarterly, v. 19, n. 5, p. 503-525, 2022.

GIRALDO, F. Fostering Pre-Service Teachers’ Language Assessment Literacy. Manizales: Editorial Universidad de Caldas, 2023.

GIRALDO, F. Language Assessment Literacy and Teachers’ Professional Development: A Review of the Literature. Profile: Issues in Teachers’ Professional Development, v. 23, n. 2, p. 265-279, 2021.

GIRALDO, F. Language Assessment Literacy for In-Service Teachers: Online Course Planning and Implementation. Manizales: Editorial Universidad de Caldas, 2024.

GIRALDO, F. Language Assessment Literacy: Implications for Language Teachers. Profile: Issues in Teachers’ Professional Development, v. 20, n. 1, p. 179-195, 2018.

GIRALDO, F.; MURCIA, D. Language Assessment Literacy for Pre-Service Teachers: Course Expectations from Different Stakeholders. GIST – Education and Learning Research Journal, n. 16,

p. 56-77, 2018.

GIRALDO, F.; VELÁSQUEZ-HOYOS, A.; VILLEGAS-LÓPEZ, L. Characterizing Teachers’ Language Assessment Literacy to Design an Online Assessment Course. Profile: Issues in Teachers’ Professional Development, v. 28, n. 2, 2026. In press.

GIRALDO, F.; YAN, X. (ed.). Fostering Language Assessment Literacy: Materials, Methods, and Emerging Issues. London: Routledge, 2025a.

GIRALDO, F.; YAN, X. Evaluating an Online Assessment Course: Teachers’ Voices on Their Language Assessment Literacy. Profile: Issues in Teachers’ Professional Development, v. 27, n. 1, p. 97-114, 2025b.

GREEN, A. Exploring Language Assessment and Testing. New York: Routledge, 2014.

GUBA, E. Criteria for Assessing the Trustworthiness of Naturalistic Inquiries. Ectj, v. 29, n. 2, p. 75-91, 1981.

HIDRI, S. (ed.). Perspectives on Language Assessment Literacy: Challenges for Improved Student Learning. London: Routledge, 2020.

INBAR-LOURIE, O. ‘A Course of Our Own’: Reflections Following a Language Assessment Literacy (LAL) Course. In: BAKER, B.; TAYLOR, L. (ed.). Language Assessment Literacy and Competence: Research and Reflections from the Field. Cambridge: Cambridge University Press & Assessment, 2024. v. 1,

p. 231-238.

INBAR-LOURIE, O. Constructing a Language Assessment Knowledge Base: A Focus on Language Assessment Courses. Language Testing, v. 25, n. 3, p. 385-402, 2008.

INBAR-LOURIE, O. Language Assessment Literacy: What are the Ingredients? In: CBLA SIG SYMPOSIUM PROGRAMME, 4., 2013, Nicosia. Proceedings […]. Nicosia: University of Cyprus, 2013.

KOH, K. et al. Developing the Assessment Literacy of Teachers in Chinese Language Classrooms:

A Focus on Assessment Task Design. Language Teaching Research, v. 22, n. 3, p. 264-288, 2018.

KREMMEL, B. et al. Fostering Language Assessment Literacy Through Teacher Involvement in High-Stakes Test Development. In: XERRI, D.; VELLA BRIFFA, P. (ed.). Teacher Involvement in High-Stakes Language Testing. Cham: Springer, 2018. p. 173-194.

KUMARAVADIVELU, B. Language Teacher Education for a Global Society: A Modular Model for Knowing, Analyzing, Recognizing, Doing, and Seeing. New York: Routledge, 2012.

LAM, R. Language Assessment Training in Hong Kong: Implications for Language Assessment Literacy. Language Testing, v. 32, n. 2, p. 169-197, 2015.

LEVI, T.; INBAR-LOURIE, O. Assessment Literacy or Language Assessment Literacy: Learning from the Teachers. Language Assessment Quarterly, v. 17, n. 2, p. 168-182, 2019.

MERRIAM, S. Qualitative Research and Case Study Applications in Education. San Francisco: Jossey-Bass, 1996.

MOHAMMADI, M. Language Teachers’ Assessment Literacy in AI-Aided Adaptive Learning Environments. Journal of Research in Applied Linguistics, v. 15, n. 2, p. 73-88, 2024.

MONTEE, M. et al. LCTL Teachers’ Assessment Knowledge and Practices: An Exploratory Study. Journal of the National Council of Less Commonly Taught Languages, v. 13, p. 1-31, 2013.

MORAES, I. T. A promoção do letramento em avaliação para a práxis de formadoras de professores/as de inglês: implicações para a formação inicial e continuada. 2023. Thesis (Doctorate in Language Studies) – Universidade Estadual de Londrina, Londrina, 2023.

NIER, V.; DONOVAN, A.; MALONE, M. Increasing Assessment Literacy Among LCTL Instructors Through Blended Learning. Journal of the National Council of Less Commonly Taught Languages, v. 9,

p. 105-136, 2009.

SCARINO, A. Developing Assessment Literacy of Teachers of Languages: A Conceptual and Interpretive Challenge. Studies in Language Assessment, v. 6, n. 1, p. 18-40, 2017.

SCARINO, A. Language Assessment Literacy as Self-Awareness: Understanding the Role of Interpretation in Assessment and in Teacher Learning. Language Testing, v. 30, n. 3, p. 309-327, 2013.

SHEEHAN, S.; THAI, T. LAL Training in Vietnam: A Teacher-Centred Approach to Resource Development. In: GIRALDO, F.; YAN, X. (ed.). Fostering Language Assessment Literacy: Materials, Methods, and Emerging Issues. New York: Routledge, 2025. p. 13-30.

SPILIOTOPOULOS, V. et al. Teacher Professional Learning Communities and Language Assessment Reform in Western Canada. In: BAKER, B.; TAYLOR, L. (ed.). Language Assessment Literacy and Competence: Case Studies from Around the World. Cambridge: Cambridge University Press & Assessment, 2024. v. 2, p. 8-19.

STABLER-HAVENER, M. Exploring the Effect of Embedding Assessments into a Professional Development Presentation as a Means of Improving Language Teachers’ Assessment Competency. In: GIRALDO, F.; YAN, X. (ed.). Fostering Language Assessment Literacy: Materials, Methods, and Emerging Issues. New York: Routledge, 2025. p. 31-53.

TAYLOR, L. Communicating the Theory, Practice and Principles of Language Testing to Test Stakeholders: Some Reflections. Language Testing, v. 30, n. 3, p. 403-412, 2013.

TSAGARI, D.; ARMOSTIS, S. Contextualizing Language Assessment Literacy: A Comparative Study of Teacher Beliefs, Practices, and Training Needs in Norway and Cyprus. Education Sciences, v. 15, n. 7,

p. 1-29, 2025.

VILLA-LARENAS, S.; BRUNFAUT, T. But who Trains the Language Teacher Educator who Trains the Language Teacher? An Empirical Investigation of Chilean EFL Teacher Educators’ Language Assessment Literacy. Language Testing, v. 40, n. 3, p. 463-492, 2023.

VOGT, K. Pre-Service Teachers’ Language Assessment Literacy Enhancement – Towards Pedagogies for LAL. In: GIRALDO, F.; YAN, X. (ed.). Fostering Language Assessment Literacy: Materials, Methods, and Emerging Issues. New York: Routledge, 2025. p. 54-76.

WENG, F.; SHEN, B. Language Assessment Literacy of Teachers. Frontiers in Psychology, v. 13, e864582, 2022.

YAN, X.; ZHANG, C.; FAN, J. “Assessment Knowledge is Important, but…”: How Contextual and Experiential Factors Mediate Assessment Practice and Training Needs of Language Teachers. System, v. 74, p. 158-168, 2018.

YIN, R. Case Study Research and Applications: Design and Methods. 6. ed. London: SAGE Publications, 2014.

ZHANG, J.; YU, G.; BROWNE, W. Teachers’ Language Assessment Literacy: Exploring its Construct and Contextual Factors. Studies in Educational Evaluation, v. 87, e101525, 2025.