Large-scale Assessments in Education
Издатель: Springer Nature · ISSN 2196-0739,2196-0739 · 104 статей
-
Student achievement and self-confidence in mathematics and science: evidence from TIMSS 2023
Abstract This paper examines whether underachieving students systematically overestimate their abilities and explores how confidence patterns vary across different contexts. Drawing on grade eight mathematics and science data from TIMSS...
-
An appraisal of small area estimation methods to explore expansion of state subgroup reporting on NAEP
Abstract This study explores the use of Small Area Estimation (SAE) methods to expand reporting of state-level subgroup performance on National Assessment of Educational Progress (NAEP) assessments without requiring the assessment...
-
Cross-national measurement invariance of TIMSS 2023 digital and environmental scales: an alignment optimization approach
Abstract Background TIMSS 2023 introduced three student-report scales—Digital Self-Efficacy, Environmental Attitudes, and Environmental Behaviors—to assess competencies relevant to 21st-century learning. Valid cross-national comparisons...
-
Beyond the average: mapping educational inequality in Brazil with PISA 2022
Abstract Background Brazil’s participation in PISA 2022 offers a unique opportunity to explore how learning outcomes vary across regions within a decentralized education system. Objective We evaluate whether PISA 2022 can generate...
-
Environmental values as predictors of environmentally responsible behaviors: insights from Norwegian TIMSS 2023 results
Abstract Understanding students’ environmental values and behaviors is important for fostering sustainable practices through education. In this study, we investigated the measurement properties and structural relationships of the...
-
The longitudinal relationship between schools’ academic optimism and academic achievement in elementary schools: evidence from a school panel study
Abstract Background Academic optimism (i.e., academic emphasis, collective efficacy, and faculty trust) describes the striving for a high-achieving learning environment. It has been identified as an important factor for students’...
-
Beyond average teaching quality: the role of instructional climate strength in student achievement across educational systems
Abstract Background International large-scale assessments such as TIMSS offer valuable insights into teaching effectiveness. However, student-reported measures often exhibit perceptual variability, raising concerns about their...
-
Parent versus student reporting of parental education drives contradictory gender patterns in achievement gradients
Abstract Research on how socioeconomic status (SES) and gender interact to affect student achievement has produced contradictory findings. Some studies suggest boys are more vulnerable to socioeconomic disadvantage; others find the...
-
Longitudinal insights into academic resilience in PISA in Italy: the role of prior achievement and upper-secondary school factors
Abstract Background Academic resilience, defined as the capacity of socio-economically disadvantaged students to achieve at high academic levels, is a key indicator in international education policy. Large-scale assessments like the...
-
Mathematics achievement in Ghana: exploring multilevel factors using TIMSS 2011
Abstract Background This study investigates the factors associated with eighth-grade mathematics achievement in Ghana, addressing the research gap by comparing student- and school-level influences. Given the persistently low mathematics...
-
Differential item functioning analysis in large scale assessments: a case study for DIF in SABER 11
Abstract Background Absence of differential item functioning (DIF) is an important piece of evidence to support inferences based on group comparisons of test results. We illustrate how to tailor the DIF identification process following...
-
Why some students excel in mathematics: growth mindset, intrinsic motivation, and school autonomy in top-performing Asian and Western economies
Abstract Mathematical proficiency in adolescence is crucial for both individual success and national economic development; yet few studies have examined cross-national differences in how achievement-related beliefs, motivations, and...
-
Who’s at risk? Characterizing low achievers in a large-scale assessment during the COVID-19 pandemic using educational data mining
Abstract Background: In response to the COVID-19 pandemic, schools experienced repeated closures from spring 2020 onwards. Subsequent analysis of educational monitoring data has revealed significant learning losses for students. For...
-
Does sequence mining uncover generalizable behavioral patterns? A methodological case study
Abstract Sequence mining techniques provide powerful tools to uncover patterns from time-stamped action sequences. The information extracted with a chosen method, however, may not necessarily be meaningful or generalize beyond the...
-
Evaluating generative AI chatbots for large-scale assessment data: comparing LLM-as-a-judge and human ratings
Abstract Introduction This study focuses on developing and evaluating a customized Generative AI chatbot designed to enhance access to large-scale educational data. The chatbot aims to assist researchers and policymakers in exploring...
-
Using multiple Q-Q plots to measure comparative change from pseudo-cohort studies
Abstract Although International Large-scale Assessment Surveys (ILSA) produce a wealth of policy-relevant information, as cross-sectional surveys they don’t yield measures of change for specific cohorts. This severely limits not only...
-
Investigating student engagement, learning, and attendance during the COVID-19 disruption: a machine learning analysis of online, hybrid, and offline learning modes
Abstract The COVID-19 pandemic profoundly impacted educational systems worldwide, catalysing a transformational shift towards digital teaching and learning at all levels. In response, schools and institutions supported teachers to...
-
In-test effort in PISA achievement: it makes a difference for students and schools, but not countries
Abstract Background Across multiple theories of psycho-educational development, task-specific effort, such as in-test effort, is postulated to be the most closely associated with achievement. Despite this, research has most frequently...
-
Detecting non-uniform differential item functioning in response time through linear regression
Abstract Recent research has expanded beyond investigating differential item functioning (DIF) in response score data to examine DIF in response times. However, studies on response time-based DIF have predominantly focused on uniform...
-
When the sandwich makes you hesitate, replicate: on sampling variance estimation of multilevel models under complex sample design
Abstract Large-scale surveys routinely rely on complex sample designs, necessitating special consideration of sampling variance estimation in multilevel models (MLM). While the sandwich estimator is widely used for this purpose, its...
-
Assessing multilevel mediation and confidence intervals in the 2–2–1 model with plausible values: simulation and recommendations
Abstract Mediation analysis in large-scale assessments often involves a multilevel structure, where students are nested within classrooms or schools. In such a context, multilevel structural equation modeling (MSEM) provides a flexible...
-
The Goldilocks dilemma: gendered patterns of social media usage and adolescent life satisfaction across OECD countries
Abstract Purpose The escalating prevalence of social media usage (SMU) among adolescents coincides with a concerning decline in their life satisfaction globally. While public and scientific discourse vigorously debates the impact of SMU...
-
Asset-based pathways to academic resilience in Korea and South Africa: a comparative study of TIMSS math achievement gaps based on risk and protective factors
Abstract Background This comparative study provides cross-cultural insights into key protective factors for disadvantaged students’ academic resilience in Korea and South Africa. Grounded in the Ecological Systems Theory and the...
-
Parental education, home resources, gender, and academic achievement: a multilevel analysis of GCC and Asia–Pacific students in TIMSS 2023
Abstract Background Student achievement is shaped by family background, gender, migration status, and school context, yet little research has compared how these factors operate across distinct world regions. This study examines how...
-
Measurement invariance in the enjoyment of reading across grades measured by IRT and DIF analysis
Abstract When measuring a phenomena across different grades it is important that the instrument measures the same way by being perceived in the same manner no matter what grade. Especially if the phenomena is a concept that should be...
-
The validity and comparability of motivational constructs in TIMSS 2019
Abstract In this article, we examined the construct-related validity of the motivational measures included in TIMSS 2019 of Grade 8 in three Nordic countries— Finland, Sweden, and Norway. We utilized confirmatory factor analysis (CFA)...
-
Identifying early developmental profiles of 5-year-olds: a latent profile analysis using IELS 2018 data
Abstract Background Previous research in early childhood development has largely focused on isolated skills in early childhood development, often neglecting the complex, interconnected nature of developmental skills. In addition,...
-
Unpacking the personality–cognitive ability link: a cross-national facet-level analysis of the Big Five
Abstract Background Numerous studies have demonstrated robust—albeit modest—associations between personality and cognitive ability, with a shared variance of 5–10%. Previous research has largely focused on global personality dimensions,...
-
Books as educational resource? Assessing cross-country measurement invariance of the TIMSS home resources for learning scale in post-conflict societies
Abstract Background International large-scale assessments collect achievement and background data to evaluate the effectiveness of teaching and learning processes, thereby informing education policy. The Western Balkan countries have...
-
Global competence behavior: exploring the relevance of students’ scientific literacy, related attitudes, and values - evidence from PISA 2018 across 52 countries
Abstract Global competence behavior is increasingly recognized as a key prerequisite for navigating cultural diversity, engaging constructively with multiple perspectives, and contributing responsibly to global sustainability and...