Effectiveness of technology interventions to promote self-regulation of learning

a meta-analysis

Authors

DOI:

https://doi.org/10.1590/1983-3652.2023.46636

Keywords:

Meta-analysis, Intervention, Self-regulation of learning, Information, and communication technologies

Abstract

The benefits of incorporating technologies in education are promising. The aim of this study was to characterize the interventions developed to promote self-regulation of learning with the use of technologies and to determine their effectiveness. The method was a meta-analysis based on PRISMA standards identifying studies in Web of Science, Scopus and Eric and their subsequent analysis and selection using Rayyan software. The sample consisted of 6 studies. Data analysis was performed with Jamovi software. The results showed an insufficient characterization of the interventions regarding the number, frequency, and duration of the sessions, all of them used Zimmerman's self-regulation model, but few studies specified a technological model. The types of technologies used were LMS and mobile applications, and the instruments were self-report Likert-type scales. The meta-analysis evidenced that the interventions were effective, provided an estimate of 0.55 with a 95% confidence interval of 0.22, 0.88. The total effect size test was significant (z = 3.25, p = 0.001). It is concluded that interventions with the use of technologies are effective in promoting self-regulation. Practical implications are presented considering these results for Higher Education.

Downloads

Download data is not yet available.

Author Biographies

Fabiola Sáez-Delgado, Universidad Católica de la Santísima Concepción, Facultad de Educación, Departamento Fundamentos de la Pedagogía, Concepción, Chile

Academic researcher of the Faculty of Education and Deputy Director of the Center for Research in Education and Development of the Catholic University of the Most Holy Conception (UCSC), Chile. Head of the Master's program in Education Sciences at UCSC. Professor, Licentiate in Education, Master in Education and PhD in Psychology from the University of Concepción, Chile. Her line of research is the motivational cognitive variables of teaching and learning processes; also the variables of mental health in educational communities. Chair in the Doctoral Program in Education at UCSC on Research in Education and Quantitative Data Analysis using R statistical software. She has specialized in systematic literature reviews, psychometrics and analysis of predictive and explanatory models in Education. Member of the International Research Group Society, Education and Psychology (GISEP). ORCID ID: https://orcid.org/0000-0002-7993-5356. Email: fsaez@ucsc.cl

Javier Mella-Norambuena, Universidad Técnica Federico Santa María, Departamento de Ciencias, Concepción, Chile

Professor of the Science Department of the Universidad Técnica Federico Santa María, Concepción, Chile. He is a professor, Bachelor in Education and Master in Health Psychology from the Universidad de Concepción, Chile. D. candidate in the Doctoral Program in Education at the Universidad Católica de la Santísima Concepción, Chile. His research interests are cognitive-motivational variables of teaching and learning processes; and mental health variables in educational communities. She has specialized in systematic literature reviews, research methodology, and quantitative data analysis with SPSS, RStudio and Python software. Member of the International Research Group Society, Education and Psychology (GISEP). ORCID ID: https://orcid.org/0000-0002-4288-142X. Email: javier.mellan@usm.cl

Yaranay López-Angulo, Universidad de Concepción, Departamento de Psicología, Concepción, Chile

Degree in Psychology, Master in Educational Psychology from the University of Havana, Cuba. PhD in Psychology from the University of Concepción, Chile. Academic of the Faculty of Social Sciences, Universidad de Concepción, Chile. Lines of research: cognitive-motivational variables related to university dropout, psychoeducation and gender. Professor of the following courses: Educational Psychology, Developmental Psychology, Methodology and Data Analysis. ORCID ID: https://orcid.org/0000-0002-3331-6875. Email: yaralopez@udec.cl

References

ALHALAFAWY, Waleed Salim y ZAKI, Marwa Zaki Tawfiq. How has gamification within digital platforms affected self-regulated learning skills during the COVID-19 pandemic? Mixed-methods research. International Journal of Emerging Technologies in Learning (Online), v. 17, n. 6, p. 123-151, 2022.

BELLHÄUSER, Henrik y col. Applying a web-based training to foster self-regulated learning—Effects of an intervention for large numbers of participants. The Internet and Higher Education, v. 31, p. 87-100, 2016.

BERNARDO, Ana y col. El meta-análisis: una metodologı́a para la investigación en educación. Educación XXI, v. 20, n. 2, p. 17-38, 2017. DOI: https://doi.org/10.5944/educXX1.18241.

BRANSEN, Derk y col. Putting self-regulated learning in context: Integrating self-, co-, and socially shared regulation of learning. Medical Education, v. 56, n. 1, p. 29-36, 2022. DOI: https://doi.org/10.1111/medu.14566.

BROADBENT, Jaclyn; PANADERO, Ernesto y FULLER-TYSZKIEWICZ, Matthew. Effects of mobile-app learning diaries vs online training on specific self-regulated learning components. Educational Technology Research and Development, v. 68, p. 2351-2372, 2020.

BUCKLEY, Jeffrey; HYLAND, Tomás y SEERY, Niall. Estimating the replicability of technology education research. International Journal of Technology and Design Education, v. 1, n. 8, p. 1-23, 2022. DOI: https://doi.org/10.1007/s10798-022-09787-6.

CARRIÓN-MARTÍNEZ, José y col. Effects of online strategies on students’ learning performance, self-efficacy, self-regulation and critical thinking in university online courses. Educational Technology Research and Development, v. 70, n. 1, p. 185-204, 2022. DOI: https://doi.org/10.1007/s11423-021-10071-y.

CONN, Vicki. Unpacking the black box: countering the problem of inadequate intervention descriptions in research reports. Western Journal of Nursing Research, v. 34, n. 4, p. 427-433, 2012. DOI: https://doi.org/10.1177/0193945911434627.

DENT, Amy L y KOENKA, Alison C. The relation between self-regulated learning and academic achievement across childhood and adolescence: A meta-analysis. Educational Psychology Review, v. 28, n. 3, p. 425-474, 2016. DOI: https://doi.org/10.1007/s10648-015-9320-8.

DIGNATH, Charlotte y BÜTTNER, Gerhard. Components of fostering self-regulated learning among students. A meta-analysis on intervention studies at primary and secondary school level. Metacognition and learning, v. 3, p. 231-264, 2008. DOI: https://doi.org/10.1007/s11409-008-9029.

DIGNATH-VAN EWIJK, Charlotte; FABRIZ, Sabine y BÜTTNER, Gerhard. Fostering self-regulated learning among students by means of an electronic learning diary: A training experiment. Journal of Cognitive Education and Psychology, v. 14, n. 1, p. 77-97, 2015. DOI: https://doi.org/10.1891/1945-8959.14.1.77.

DOROUKA, Pandora; PAPADAKIS, Stamatis y KALOGIANNAKIS, Michail. Tablets and apps for promoting robotics, mathematics, STEM education and literacy in early childhood education. International Journal of Mobile Learning and Organisation, v. 14, n. 2, p. 255-274, 2020. DOI: https://doi.org/10.1504/IJMLO.2020.106179.

ERGEN, Binnur y KANADLI, Sedat. The effect of self-regulated learning strategies on academic achievement: A meta-analysis study. Eurasian Journal of Educational Research, v. 17, n. 69, p. 55-74, 2017. DOI: https://doi.org/10.14689/ejer.2017.69.4.

GARZÓN, Juan; PAVÓN, Juan y BALDIRIS, Silvia. Systematic review and meta-analysis of augmented reality in educational settings. Virtual Reality, v. 23, n. 4, p. 447-459, 2019. DOI: https://doi.org/10.1007/s10055-019-00379-9.

HOLTGRAVES, Thomas. Social desirability and self-reports: Testing models of socially desirable responding. Personality and Social Psychology Bulletin, v. 30, n. 2, p. 161-172, 2004. DOI: https://doi.org/10.1177/0146167203259930.

HUANG, Rui y col. The impact of gamification in educational settings on student learning outcomes: a meta-analysis. Educational Technology Research and Development, v. 68, n. 4, p. 1875-1901, ago. 2020. ISSN 1042-1629, 1556-6501. DOI: 10.1007/s11423-020-09807-z. Disponible en: https://link.springer.com/10.1007/s11423-020-09807-z. Acceso en: 1 sep. 2023.

JANSEN, Renée y col. Fostering self-regulated learning in a blended environment using group awareness and peer assistance as external scaffolds. Journal of Computer Assisted Learning, v. 32, n. 1, p. 77-93, 2016. DOI: https://doi.org/10.1111/jcal.12120.

LOBOS, Karla y col. Design, validity and effect of an intra-curricular program for facilitating self-regulation of learning competences in university students with the support of the 4planning app. Education Sciences, v. 11, n. 8, p. 1-16, 2021. DOI: https://doi.org/10.3390/educsci11080449.

MATCHA, Wannisa; GAŠEVIĆ, Dragan; PARDO, Abelardo y col. A systematic review of empirical studies on learning analytics dashboards: A self-regulated learning perspective. Transactions on learning technologies, v. 13, n. 2, p. 226-245, 2020. DOI: https://doi.org/10.1109/TLT.2019.2916802.

MAYER, Richard. The promise of multimedia learning: using the same instructional design methods across different media. Learning and instruction, v. 13, n. 2, p. 125-139, 2003. DOI: https://doi.org/10.1016/s0959-4752(02)00016-6.

MOHER, David y col. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews, v. 4, n. 1, p. 1-9, 2015. DOI: https://doi.org/10.1136/bmj.g7647.

NEIRA, Edgar; SALINAS, Jesus y CROSETTI, Barbara. Emerging technologies (ETs) in education: A systematic review of the literature published between 2006 and 2016. International Journal of Emerging Technologies in Learning, v. 12, n. 5, p. 128-149, 2017. DOI: https://doi.org/10.3991/ijet.v12i05.6939.

OLIVEIRA, Alandeom y col. Emerging technologies as pedagogical tools for teaching and learning science: A literature review. Human Behavior and Emerging Technologies, v. 1, n. 2, p. 149-160, 2019. DOI: https://doi.org/10.1002/hbe2.141.

PINO, Cécile; BOUTRON, Isabelle y RAVAUD, Philippe. Inadequate description of educational interventions in ongoing randomized controlled trials. Trials, v. 13, n. 1, p. 1-8, 2012. DOI: https://doi.org/10.1186/1745-6215-13-63.

ROJAS-GARCÍA, Paula y col. The analysis of educational interventions with video games in secondary education: a systematic review. Texto Livre, v. 15, p. 1-20, 2022. DOI: https://doi.org/10.35699/1983-3652.2022.37810.

SÁEZ-DELGADO, Fabiola; DÍAZ-MUJICA, Alejandro E y col. Impacto de un programa intracurricular sobre la disposición al estudio en universitarios. Formación Universitaria, v. 13, n. 4, p. 101-110, 2020. DOI: https://doi.org/10.4067/S0718-50062020000400101.

SÁEZ-DELGADO, Fabiola; MELLA-NORAMBUENA, Javier; LÓPEZ-ANGULO, Yaranay; OLEA-GONZÁLEZ, Constanza y col. Association between self-regulation of learning, forced labor insertion, technological barriers, and dropout intention in Chile. v. 6, p. 1-10, 2021. DOI: https://doi.org/10.3389/feduc.2021.801865.

SÁEZ-DELGADO, Fabiola; MELLA-NORAMBUENA, Javier; LÓPEZ-ANGULO, Yaranay; SÁEZ, Yenniffer y col. Invariant and suboptimal trajectories of self-regulated learning during secondary school: implications focused on quality in higher education. Frontiers in Psychology, v. 14, p. 1-12, 2023. DOI: https://doi.org/10.3389/fpsyg.2023.1235846.

STANLEY, Tom D; CARTER, Evan C y DOUCOULIAGOS, Hristos. What meta-analyses reveal about the replicability of psychological research. Psychological Bulletin, v. 144, n. 12, p. 1325-1346, 2018. DOI: https://doi.org/10.1037/bul0000169.

VAN DER BEEK, Sophie y col. New ways in fostering self-regulated learning at university: How effective are web-based courses when compared to regular attendance-based courses? Zeitschrift für Pädagogische Psychologie, v. 34, n. 2, p. 117-129, 2020. DOI: https://doi.org/10.1024/1010-0652/a000254.

VIBERG, Olga; HATAKKA, Mathias y col. The current landscape of learning analytics in higher education. Computers in human behavior, v. 89, p. 98-110, 2018. DOI: https://doi.org/10.1016/j.chb.2018.07.027.

VIBERG, Olga; WASSON, Barbara y KUKULSKA-HULME, Agnes. Mobile-assisted language learning through learning analytics for self-regulated learning (MALLAS): A conceptual framework. Australasian Journal of Educational Technology, v. 36, n. 6, p. 34-52, 2020. DOI: https://doi.org/10.14742/AJET.6494.

WILLIAMS, Ashley. User-centered design, activity-centered design, and goal-directed design: a review of three methods for designing web applications. In: PROCEEDINGS of the 27th ACM international conference on Design of communication. [S.l.: s.n.], 2009. p. 1-8. DOI: https://doi.org/10.1145/1621995.1621997.

WONG, Jacqueline y col. Supporting self-regulated learning in online learning environments and MOOCs: A systematic review. International Journal of Human–Computer Interaction, v. 35, n. 4-5, p. 356-373, 2019. DOI: https://doi.org/10.1080/10447318.2018.1543084.

ZIMMERMAN, Barry J. Attaining Self-Regulation. In: HANDBOOK of Self-Regulation. [S.l.]: Elsevier, 2000. p. 13-39. ISBN 9780121098902. DOI: 10.1016/B978-012109890-2/50031-7. Disponible en: https://linkinghub.elsevier.com/retrieve/pii/B9780121098902500317. Acceso en: 1 sep. 2023.

Published

2023-09-04

How to Cite

SÁEZ-DELGADO, F.; PARRA, F.; JARA, P.; MELLA-NORAMBUENA, J.; LÓPEZ-ANGULO, Y. Effectiveness of technology interventions to promote self-regulation of learning: a meta-analysis. Texto Livre, Belo Horizonte-MG, v. 16, p. e46636, 2023. DOI: 10.1590/1983-3652.2023.46636. Disponível em: https://periodicos.ufmg.br/index.php/textolivre/article/view/46636. Acesso em: 13 may. 2024.

Most read articles by the same author(s)