Cover not available

Article published In: TASK
Vol. 5:1 (2025) ► pp.57–87

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB

Exploring pre-service teachers’ criteria for evaluating collaboratively designed online tasks

ORCiD logo with link | Universität Innsbruck, Austria
 | Universität Innsbruck, Austria
ORCiD logo with link | Universität Innsbruck, Austria
 | Universität Innsbruck, Austria
Open Access logo
Available under the Creative Commons Attribution (CC BY) 4.0 license.

For any use beyond this license, please contact the publisher at rights@benjamins.nl.

This article was made Open Access under a CC BY 4.0 license through payment of an APC by or on behalf of the authors.

Published online: 8 August 2025
DOI logo with link
https://doi.org/10.1075/task.24001.sch
Abstract
This study examines the criteria that pre-service teachers (PSTs) use to evaluate collaboratively designed technology-mediated interaction tasks. The paper presents PSTs’ reflections on tasks as part of a telecollaborative task design seminar conducted within the ERASMUS+ project DIGITASK4IC. During the seminar, PSTs from three universities collaborated using the DIGITASK Web App to create interaction tasks for EFL learners. The study utilizes two datasets: transcribed recordings of group discussions and written end-of-term reports. Qualitative content analysis was employed to investigate specific criteria that PSTs rely on when evaluating technology-mediated tasks. The results suggest that PSTs evaluate tasks based on criteria related to digital tools, task instructions, outcome, and interaction that only partially overlap with task criteria in theoretical models.
Article outline
  • 1.Introduction
  • 2.Literature review
    • 2.1Task evaluation
    • 2.2Task criteria used by pre- and in-service teachers
    • 2.3Criteria for technology-mediated tasks
    • 2.4Reflective practice in pre- and in-service teachers
  • 3.Research questions
  • 4.Research methodology
    • 4.1Participants
    • 4.2Seminar description and design
    • 4.3Data collection and analysis
      • 4.3.1Data collection and datasets
      • 4.3.2Data analysis
  • 5.Results
  • 6.Discussion
  • 7.Conclusion
  • Acknowledgements
  • Attribution
  • References
References (59)
References
Barkhuizen, G., & Wette, R. (2008). Narrative frames for investigating the experiences of language teachers. System, 36(3), 372–387. Google Scholar logo with link to Google Scholar
Barnard, R., & Nguyen, G. V. (2010). Task-based language teaching (TBLT): A Vietnamese case study using narrative frames to elicit teachersʼ beliefs. Language Education in Asia 1(1), 77–86. Google Scholar logo with link to Google Scholar
Bean, T. W., & Stevens, L. P. (2002). Scaffolding reflection for preservice and inservice teachers. Reflective Practice, 31, 205–218. Google Scholar logo with link to Google Scholar
Becerra-Posada, T., & Arroyo, D. C. (2023). Colombian preservice teachers enacting task-based language teaching principles before and during the transition to remote teaching. Profile: Issues in Teachers’ Professional Development, 25(2), 29–47. Google Scholar logo with link to Google Scholar
Chan, C. K. Y., & Lee, K. K. W. (2021). Reflection literacy: A multilevel perspective on the challenges of using reflections in higher education through a comprehensive literature review. Educational Research Review, 321. Google Scholar logo with link to Google Scholar
Chapelle, C. A. (Ed.). (2001). Computer applications in second language acquisition. Cambridge University Press. Google Scholar logo with link to Google Scholar
Cohen, E. G. (1994). Designing groupwork: Strategies for heterogeneous classrooms. Teachers College Press.Google Scholar logo with link to Google Scholar
Collin, S., Karsenti, T., & Komis, V. (2013). Reflective practice in initial teacher training: critiques and perspectives, Reflective Practice, 14(1), 104–117. Google Scholar logo with link to Google Scholar
Cutrer-Parraga, E. A., & Miller, E. E. (2022). The role of reflection in supporting initially resistant teachers’ implementation of targeted reading instruction. Frontiers in Education, 71. Google Scholar logo with link to Google Scholar
Dewey, J. (1933). How we think: A Restatement of the relation of reflective thinking to the educative process. Heath & Co Publishers.Google Scholar logo with link to Google Scholar
Doughty, C. J., & Long, M. H. (2003). Optimal psycholinguistic environments for distance foreign language learning. Language Learning & Technology, 7(3), 50–80. Google Scholar logo with link to Google Scholar
East, M. (2014a). Encouraging innovation in a modern foreign language initial teacher education programme: What do beginning teachers make of task-based language teaching? The Language Learning Journal, 42(3), Special issue: Modern Language Teacher Education. Google Scholar logo with link to Google Scholar
(2014b). Mediating pedagogical innovation via reflective practice: A comparison of pre-service and in-service teachers’ experiences. Reflective Practice, 15(5), 686–699. Google Scholar logo with link to Google Scholar
(2018). How do beginning teachers conceptualise and enact tasks in school foreign language classrooms? In V. Samuda, K. Van den Branden, M. Bygate (Eds.), TBLT as a researched pedagogy (pp. 23–50). John Benjamins. Google Scholar logo with link to Google Scholar
(2019). Sustaining innovation in school modern foreign language programmes: Teachers’ reflections on task-based language teaching three years after initial teacher education. The Language Learning Journal, 47(1), 105–115. Google Scholar logo with link to Google Scholar
(2021). Foundational principles of task-based language teaching. Routledge. Google Scholar logo with link to Google Scholar
Ellis, R. (2003). Task-based language learning and teaching. Oxford University Press.Google Scholar logo with link to Google Scholar
(2011). Macro- and micro-evaluations of task-based teaching. In B. Tomlinson (Ed.), Materials development in language teaching (pp. 212–235). Cambridge University Press. Google Scholar logo with link to Google Scholar
(2015). Teachers evaluating tasks. In M. Bygate (Ed.), Domains and directions in the development of TBLT: A decade of plenaries from the international conference (pp. 247–269). John Benjamins. Google Scholar logo with link to Google Scholar
Ellis, R., & Shintani, N. (2014). Exploring language pedagogy through second language acquisition Research. Routledge.Google Scholar logo with link to Google Scholar
Ellis, R., Skehan, P., Li, S., Shintani, N., & Lambert, C. (2019). Task-based language teaching: Theory and practice. Cambridge University Press. Google Scholar logo with link to Google Scholar
González-Lloret, M., & Ortega, L. (2014). Towards technology-mediated TBLT: An introduction. In M. González-Lloret & L. Ortega (Eds.), Technology-mediated TBLT (pp. 1–22). John Benjamins. Google Scholar logo with link to Google Scholar
Hallet, W. (2020). Komplexe Aufgaben für den digitalen Distanz- und den Präsenzunterricht konzipieren. Der Fremdsprachliche Unterricht Englisch, 1671, 10–13.Google Scholar logo with link to Google Scholar
Hampel, R. (2006). Rethinking task design for the digital age: A framework for language teaching and learning in a synchronous online environment. ReCALL, 18(1), 105–121. Google Scholar logo with link to Google Scholar
(2010). Task design for a virtual learning environment in a distant language course. In M. Thomas & H. Reinders (Eds.), Task-based language learning and teaching with technology (pp. 131–153). Continuum.Google Scholar logo with link to Google Scholar
Jolly, D., & Bolitho, R. (2011). The process of materials writing. In B. Tomlinson (Ed.), Materials development and language teaching. (pp. 107–134). Cambridge University Press. Google Scholar logo with link to Google Scholar
Kelle, U., & Kluge, S. (2010). Vom Einzelfall zum Typus. Fallvergleich und Fallkontrastierung in der qualitativen Sozialforschung. VS Verlag für Sozialwissenschaften. Google Scholar logo with link to Google Scholar
Killion, J., & Todnem, G. (1991). A process for personal theory building. Educational Leadership, 481, 14–17. [URL]
Korthagen, F. A. J. (2011). Making teacher education relevant for practice: The pedagogy of realistic teacher education. Orbis Scholae, 5(2), 31–50. Google Scholar logo with link to Google Scholar
Kurek, M., & Müller-Hartmann, A. (2017). Task design for telecollaborative exchanges: In search of new criteria. System, 641, 7–20. Google Scholar logo with link to Google Scholar
Li, J., & Zou, W. (2022). A study of pre-service teachers’ perceptions of task-based language teaching via metaphor analysis in a Chinese context. Journal of Education for Teaching, 48(5), 508–520. Google Scholar logo with link to Google Scholar
Long, M. H. (2014). Second language acquisition and task-based language classroom. Routledge.Google Scholar logo with link to Google Scholar
Mayring, P. (2010). Qualitative Inhaltsanalyse. In G. Mey & K. Mruck (Eds.), Handbuch qualitative Forschung in der Psychologie (pp. 601–613). VS Verlag für Sozialwissenschaften. Google Scholar logo with link to Google Scholar
(2022). Qualitative content analysis: A step-by-step guide. Sage.Google Scholar logo with link to Google Scholar
Mayring, P., & Brunner, E. (2013). Qualitative Inhaltsanalyse. In B. Friebertshäuser (Ed.), Handbuch. Qualitative Forschungsmethoden in der Erziehungswissenschaft (pp. 323–333). Beltz.Google Scholar logo with link to Google Scholar
Mayring, P., & Fenzl, T. (2019). Qualitative Inhaltsanalyse. In N. Baur & J. Blasius (Eds.), Handbuch Methoden der empirischen Sozialforschung (2nd ed., pp. 633–648). Springer. Google Scholar logo with link to Google Scholar
Meskill, C. (1999). Computers as tools for sociocollaborative language learning. In K. Cameron (Ed.), Computer assisted language learning (CALL): Media, design and applications (pp. 141–162). Swets & Zeitlinger.Google Scholar logo with link to Google Scholar
Müller-Hartmann, A. (2000). The role of tasks in promoting intercultural learning in electronic learning networks. Language Learning & Technology, 4(2), 129–147.Google Scholar logo with link to Google Scholar
Müller-Hartmann, A., & Schocker-v. Ditfurth, M. (2011). Task-supported language learning. UTB.Google Scholar logo with link to Google Scholar
Namey, E., Guest, G., Thairu, L., & Johnson, L. (2008). Data reduction techniques for large qualitative data sets. In G. Guest & K. M. MacQueen (Eds.), Handbook for team-based qualitative research (pp. 137–161). AltaMira Press.Google Scholar logo with link to Google Scholar
Nunan, D. (2004). Task-based language teaching. Cambridge University Press. Google Scholar logo with link to Google Scholar
O’Dowd, R. (2017). Exploring the impact of telecollaboration in initial teacher education: The EVALUATE project. The EuroCALL Review, 25, 38. Google Scholar logo with link to Google Scholar
O’Dowd, R., & Waire, P. (2009). Critical issues in telecollaborative task design. Computer Assisted Language Learning, 22(2), 173–188. Google Scholar logo with link to Google Scholar
Oliver, R., & Bogachenko, T. (2018). Teacher perceptions and use of tasks in school ESL classrooms. In V. Samuda, K. Van den Branden, & M. Bygate (Eds.), TBLT as a researched pedagogy (pp. 71–96). John Benjamins. Google Scholar logo with link to Google Scholar
Oxford, R. (2006). Task-based language teaching and learning: An overview. Asian EFL Journal, 8(3), 94–121.Google Scholar logo with link to Google Scholar
Pelletier, G. N., Chazan, D. J., Goegan, L., & Daniels, L. M. (2020). Agreeing is not the same as accepting: Exploring pre-service teachers’ growth mindsets. Canadian Journal for New Scholars in Education, 11(2). [URL]
Pinnegar, S., & Lay, C. D. (2023). Editorial: The role of reflection in teacher and teacher educator development. Frontiers in Education, 81. Google Scholar logo with link to Google Scholar
Rädiker, S., & Kuckartz, U. (2019). Analyse qualitativer Daten mit MAXQDA. Text, Audio und Video. Springer. Google Scholar logo with link to Google Scholar
R Core Team. (2024). R: A language and environment for statistical computing (Version 4.4.1). R Foundation for Statistical Computing. [URL]
Reinhoffer, B. (2008). Lehrkräfte geben Auskunft über ihren Unterricht. In M. Gläser-Zikuda & P. Mayring (Eds.), Die Praxis der Qualitativen Inhaltsanalyse (pp. 123–141). UTB.Google Scholar logo with link to Google Scholar
Schön, D. A. (1983). The reflective practitioner: How professionals think in action. Ashgate.Google Scholar logo with link to Google Scholar
Schreier, M. (2012). Qualitative content analysis in practice. Sage. Google Scholar logo with link to Google Scholar
Taglieber, J., Kremmel, B., Tuna, M. H., Hoffmann, T. D., Takim, A., Schreiner, C., & Kapelari, S. (2022). Fragenkatalog Ethik. Selbstevaluation zur Einhaltung ethischer Rahmenrichtlinien und rechtlicher Vorgaben bei der Durchführung von Forschungsprojekten. Universität Innsbruck. Retrieved on 24 March 2025 from [URL]
Vandommele, G., Van Gorp, K., & Van den Branden, K. (2018). Task-based language teaching: How task-based is it really? A case study into the use of tasks by more experienced and less experienced teachers. In V. Samuda, K. Van den Branden, & M. Bygate (Eds.), Task-based language teaching as a researched pedagogy (pp. 165–197). John Benjamins. Google Scholar logo with link to Google Scholar
VERBI software. (2021). MAXQDA 2022 [Computer software]. [URL]
Wickham, H. (2016). ggplot2: Elegant graphics for data analysis (Version 3.3.5). Springer. Google Scholar logo with link to Google Scholar
Zhang, Y., & Wildemuth, B. M. (2009). Qualitative analysis of content. In B. M. Wildemuth (Ed.), Applications of social research methods to questions in information and library science (pp. 1–12). Libraries Unlimited.Google Scholar logo with link to Google Scholar
Zheng, X., & Borg, S. (2013). Task-based learning and teaching in China: Secondary school teachers’ beliefs and practices. Language Teaching Research, 181, 205–221. Google Scholar logo with link to Google Scholar
Cited by (3)

Cited by three other publications

Konzett‐Firth, Carmen & Ufuk Balaman
2025. From a Learner's Perspective: Tracing L2 Interactional Competence Development in Video‐Mediated Task‐Based Interactions. International Journal of Applied Linguistics DOI logo
Uyar, Gülşah & Ufuk Balaman
2025. Claims of teacher learning and retrospective tracing of claimed events in video-mediated transnational virtual exchange interactions. Applied Linguistics DOI logo
Çolak, Fulya & Ufuk Balaman
2025. Dealing with divergent feedback trajectories in video-mediated, transnational, and collaborative task design meetings. Learning, Culture and Social Interaction 54 ► pp. 100936 ff. DOI logo

This list is based on CrossRef data as of 18 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue