Journal of Media Literacy Education Pre-Prints

Document Type

Research Article

Abstract

This study examines factors that enable and hinder the evaluation of Media Literacy (ML) and Digital Skills (DS) interventions across three countries and four contexts: in-service teachers in Estonia, elderly populations in Jyväskylä (Finland), vocational students in Helsinki (Finland), and pre-service teachers in Poland. Guided by the Logic Model framework, it explores barriers and enablers across Inputs, Activities, Outputs, and Outcomes to reveal structural and contextual elements shaping evaluation effectiveness. Findings cluster into four domains: organisational and administrative factors, intervention design, evaluation processes, and participant engagement. Organisational challenges such as staff turnover disrupted alignment between intervention and evaluation goals, while strong partnerships supported implementation. Short engagement periods limited long-term impact assessment, but integrated designs enhanced relevance. Misaligned tools restricted evaluation, whereas context-sensitive adaptations, like simplified surveys, improved data quality. Clear information and tailored incentives strengthened participation. The study highlights the need for inclusive, empirically robust, and context-sensitive evaluation frameworks.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.

Share

COinS
 
 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.