Large-scale Assessments in Education
Издатель: Springer Nature · ISSN 2196-0739,2196-0739 · 104 статей
-
Unpacking Chinese teacher job satisfaction: multilevel mediation and moderation of collaborative professional learning, efficacy, and innovation support
Abstract Understanding the factors contributing to teacher job satisfaction is crucial for improving educational outcomes and teacher retention. Drawing on data from the 2018 Teaching and Learning International Survey (TALIS) in...
-
Do increasing participation rates in early childhood education narrow the reading achievement gap between high- and low-SES primary school students?
Abstract Background Many countries around the world are expanding the enrollment of children in early childhood education (ECE) outside the home to improve school readiness and, ultimately, academic achievement. While socioeconomically...
-
The basics of conditioning models: stability of marginal and conditional achievement to model specification
Abstract This study investigates how different conditioning model specifications affect the stability of marginal and subgroup achievement distributions in large-scale assessments. Through both a simulation and an empirical example...
-
How lessons learned from NAEP 2022 during the COVID-19 pandemic can improve remote online learning
Abstract Background This study’s background is situated within the overlap between the 2022 administration of the National Assessment of Educational Progress (NAEP) and the COVID-19 pandemic. This made NAEP 2022 useful as a nationally...
-
Socioeconomic status and scientific literacy: expanding educational inequalities during the COVID-19 pandemic—insights from PISA 2018 and 2022
Abstract The COVID-19 pandemic has profoundly affected academic performance, intensifying existing disparities among students from lower socioeconomic status (SES) backgrounds, especially in the subjects mathematics and reading. This...
-
Toward a more discriminative and culturally responsive TALIS teacher self-efficacy in multicultural classrooms scale: cross-national evidence from Japan and Colombia using the generalized partial credit model
Abstract Background The Teacher Self-Efficacy in Multicultural Classrooms (TSMC) scale, included in the Teaching and Learning International Survey (TALIS) 2018, aims to measure teachers’ confidence in handling culturally diverse...
-
Association between school climate, teachers’ self-efficacy, instructional practice, and perceived needs in professional development: a structural equation analysis using Shanghai TALIS 2018 data
Abstract Background Teachers’ professional development is a pivotal aspect of educational psychology. However, the lack of comprehensive examination into the interconnectedness of school climate, teachers’ self-efficacy, and...
-
Irt-latent regression with many predictors: limits and solutions
Abstract Many large-scale assessments model proficiency with a latent regression on contextual variables. Item-response data are used to estimate the parameters of the latent variable model and are used in conjunction with the...
-
The global link between food insecurity and student achievement
Abstract Food insecurity remains a crucial issue across the globe, including in developed countries. In this study, we examined the relationship between food insecurity and student math achievement globally. We used novel, student-level...
-
Principal component analysis on the covariance matrix for data reduction in large-scale assessments
Abstract The standard methodology for many large-scale assessments in education involves regressing latent variables on numerous contextual variables to estimate proficiency distributions. To reduce the number of contextual variables...
-
Rethinking TIMSS quality assurance: utilizing neural network models with regression-based bias mitigation strategies for validating country-level math and science achievement scores
Abstract This study presents a novel approach to improving quality assurance in the Trends in International Mathematics and Science Study (TIMSS). It utilizes a combination of neural networks and regression analysis to validate...
-
Linking errors introduced by rapid guessing responses when employing multigroup concurrent IRT scaling
Abstract Background Test score comparability in international large-scale assessments (LSAs) is greatly important to ensure test fairness. To effectively compare test scores on an international scale, score linking is widely used to...
-
Balancing teacher-led and student-led learning in science: the importance of cognitive load
Abstract A considerable body of research on student-led learning focuses on approaches such as inquiry learning in science education. However, the effectiveness of such approaches for developing conceptual understanding is less than...
-
From framework to functionality: A cross-country analysis of PISA 2018 reading assessment framework’s item features as determinants of item difficulty
Abstract Background Theoretical frameworks excel in conceptualising reading literacy, yet their value hinges on their applicability for real-world purposes, such as assessment. By combining diverse theoretical frameworks, the Programme...
-
Access to civics content and evidence-based instructional approaches in U.S. schools
Abstract Background Civic learning is an increasingly salient topic in research, policy, and practice. However, the recent empirical evidence on access to civic learning opportunities in the U.S. is limited, and monitoring learning...
-
COVID-19 and inequality in reading outcomes in South Africa: PIRLS 2016 and 2021
Abstract This paper examines the effect of COVID-19 on learning loss and learning inequality in South Africa using 2016 and 2021 Grade 4 PIRLS datasets. On average, South African Grade 4 reading achievement declined by 31 PIRLS points...
-
Identifying students’ solution strategies in digital mathematics assessment using log data
Abstract Background Students take many tests and exams during their school career, but they usually receive feedback about their test performance based only on an analysis of the item responses. With the increase in digital assessment,...
-
Interest, enjoyment, and confidence in mathematics in the United States: exploring patterns across age, gender, race, and time
Abstract Background Although prior research has explored students’ affective experiences in mathematics and its demographic correlatives, additional studies are needed that: (1) use large national data sets; (2) incorporate a broad...
-
Data quality disparities in large-scale assessments: insufficient effort responding across student groups, schools, and cultures
Abstract Although self-report surveys are widely used for data collection, data quality can vary across populations because certain groups are more likely to engage in insufficient effort responding (IER). Our study examined how...
-
Evaluating AI-generated vs. human-written reading comprehension passages: an expert SWOT analysis and comparative study for an educational large-scale assessment
Abstract Background The increasing capabilities of generative artificial intelligence (AI), exemplified by OpenAI’s transformer-based language model GPT-4 (ChatGPT), have drawn attention to its application in educational contexts. This...
-
Teachers’ team innovativeness in TALIS 2018: An empirical and simulation study using glmmLasso for multilevel data
Abstract Background Teachers’ team innovativeness—the collective capacity of teaching teams to generate, adopt, and implement new ideas and practices—is increasingly recognized for its role in enhancing instructional methods and...
-
Relationship between teachers’ cognitive activation practices, teacher characteristics and student achievement in science subdomains: a study of TIMSS 2019 in Sweden
Abstract Background Science skills play a crucial role in fostering economic development and technological innovation, making the enhancement of science education a global priority. Despite the recognized importance of teacher practices...
-
Positive teacher feedback and adolescents’ reading self-efficacy: a quasi-experimental analysis using PISA 2018
Abstract Positive teacher feedback plays a crucial role in student learning. While previous studies on positive teacher feedback have primarily focused on its relationship with student achievement, much less attention has been given to...
-
Stability in student well-being and educational disparities across the pandemic: a latent profile analysis of PISA 2018 and 2022 in Finland, Sweden, and Iceland
Abstract This study examined changes in student well-being and its relationship with academic performance, in light of concerns about rising inequalities caused by the COVID-19 pandemic. It utilized PISA student surveys and reading and...
-
Impact of differential item functioning on item model fit using concurrent equating method
Abstract This study aimed to evaluate the item model fit by equating the forms of the PISA 2018 mathematics subtest with concurrent common items equating in samples from Türkiye, the UK, and Italy. The answers given in mathematics...
-
Working with missing data in large-scale assessments
Abstract Missing data are common with large scale assessments (LSAs). A typical approach to handling missing data with LSAs is the use of listwise deletion, despite decades of research showing that approach can be a suboptimal strategy...
-
Beyond achievement gaps: inequalities in affective components of math learning
Abstract Background Comparative educational research has studied inequality in educational outcomes through large-scale assessments like PISA and TIMSS, by identifying achievement gaps within social groups (e.g., gender, parental...
-
Exploring differential change in student performance during the COVID-19 pandemic across the United States
Abstract Although the COVID-19 pandemic was a major disruptor to K-12 learning and instruction in general, there is particular concern that there was differential impact by student group and instructional mode offered (e.g., in-person...
-
Evaluating uncertainty: the impact of the sampling and assessment design on statistical inference in the context of ILSA
Abstract This paper informs users of data collected in international large-scale assessments (ILSA), by presenting arguments underlining the importance of considering two design features employed in these studies. We examine a common...
-
Reassessing weights in large-scale assessments and multilevel models
Abstract When analyzing large-scale assessments (LSAs) that use complex sampling designs, it is important to account for probability sampling using weights. However, the use of these weights in multilevel models has been widely debated,...