Validation gaps in Education

Representative open questions

Showing 30 of 501 — one per source paper, highest-quality first.

• Power-Optimized AI-Enhanced Telepresence Robots: A Validated Multi-Modal Framework for Sustainable Remote Learning in Higher Education (2026) · doi

  Volunteer recruitment of educators and students introduces self-selection bias toward technology-inclined users; the system's effectiveness with stratified populations varying in digital literacy levels and technology receptiveness has not been evaluated through randomized or stratified sampling designs.

• El desarrollo de la comprensión del aspecto matemático del logaritmo mediante la intuición y la axiomatización en los estudiantes de Licenciatura en Educación Secundaria con especialidad en Matemáticas al término de la aplicación de su programa educativo. (2026) · doi

  The authors acknowledge that discrepancies exist between hand-calculated logarithmic results (using characteristic-mantissa separation) and calculator results, noting differences on the order of thousandths, but provide no systematic analysis of error accumulation patterns or guidelines for when hand-calculated methods are sufficiently accurate for pedagogical purposes.

• e-DigCompEdu: Digital Competences for Online Higher Education Framework (2026) · doi

  The framework identifies responsible use of digital technologies (6.4) as essential for ensuring learners' 'physical, psychological and social wellbeing' in online higher education environments, but provides no specific assessment methods or risk indicators to measure or monitor these wellbeing outcomes.

• Error Patterns and Predictors in Solving Algebraic Word Problems: Evidence from Secondary School Students (2026) · doi

  Teachers report using algebra tiles and balance-scale manipulatives to address equation equivalence and inverse operations, but the paper does not quantify the effectiveness of these visual aids through experimental comparison or measure their impact on reducing process skill errors (reported at 67.5-87.5% frequency) across different student populations.

• ChatGPT in computer programming education: A review of current literature and applications (2026) · doi

  The interaction between AI-generated feedback and human evaluation in programming instruction requires empirical investigation to determine optimal combinations for ensuring accuracy, contextual relevance, and conceptual depth. Studies comparing hybrid feedback approaches against single-modality feedback are needed.

• Coding Science: The Role of Block-Based Programming Activities in Enhancing Computational Thinking and Science Achievement (2026) · doi

  Future research should examine whether science assessments emphasizing process-oriented skills such as predicting motion under varying parameters would reveal more pronounced advantages of block-based programming integration compared to traditional assessments focused on static knowledge.

• When teachers learn by observation: Vicarious reinforcement and student response systems in teacher education (2026) · doi

  While the study reports that QR code functionality malfunctioned during presentations, requiring manual data entry and disrupting interactive flow, there is no systematic analysis of how technical failures in student response systems affect the timing and effectiveness of vicarious reinforcement delivery or long-term adoption intentions among teacher educators.

• A(n) (re)awakening: preservice teachers connecting their culture to science teaching along the US–México border (2026) · doi

  The study's small purposive sample of six Latina/o preservice teachers from two border universities limits transferability of findings to other cultural groups and non-border contexts; research with larger, more diverse samples across multiple geographic regions and ethnic backgrounds is needed to test the Community Cultural Wealth framework in science teacher preparation.

• When faces trigger feelings: multi-stakeholder experiences, use, and expectations of facial-emotion learning technologies and materials for autistic people (2026) · doi

  The paper identifies a gap in connecting learned facial-emotion recognition from apps to real-world social interactions and communication outcomes. Longitudinal studies are needed to measure whether facial-emotion learning technology translates to improved emotion naming, emotion regulation, and social interaction success in autistic users' daily environments.

• The current landscape of teachers artificial intelligence acceptance: Relationships with TPACK and technostress (2026) · doi

  The relationship between sustainable professional learning ecosystems (collaborative communities, reverse mentoring) and both technopedagogical readiness and technostress reduction in AI adoption contexts has not been empirically validated through longitudinal or experimental designs.

• Effect of Van Hiele group guided-discovery instructional approach on student engagement in learning plane geometry (2026) · doi

  The control group using traditional methods showed only minor improvements in cognitive and behavioral engagement components, but minimal data is provided on what specific traditional instructional practices were used. Future research should systematically compare VHGGDIA against multiple traditional geometry teaching approaches (direct instruction, worked examples, discovery without Van Hiele scaffolding) to isolate the contribution of the Van Hiele framework.

• On the development and potential influential aspects of prospective science teachers’ competencies for the use of explainer videos for learning in physics education (2026) · doi

  The illusion of understanding phenomenon identified in first-year physics students using explainer videos has not been systematically investigated in prospective teachers; direct empirical testing of whether prospective teachers experience similar illusions of understanding requires comparative study designs with comprehension assessments.

• Pluriliteracies for global citizenship: the 4Rs framework for deeper learning in the modern language(s) classroom (2026) · doi

  The paper proposes the 4Rs framework (Reading, Repositioning, Reflecting, Responding) as the language-as-discipline equivalent of DOEA, but does not empirically validate how these four practices operate distinctively in modern language classrooms compared to natural sciences or history classrooms where DOEA has been systematized. Comparative empirical studies are needed to specify the characteristic genres and activity domains through which language learners construct disciplinary knowledge.

• Digital Disruption of Academic Integrity (2026) · doi

  The study was limited to postgraduate students at public universities in Kenya; the generalizability of the IT mediation effects on the plagiarism-awareness-integrity relationship to undergraduate populations, private institutions, or different geographic contexts with varying technology access and policy frameworks requires cross-cultural and cross-institutional validation.

• No one-size-fits-all: a study of prompt techniques and large language models to enhance AI’s mathematics educational quality (2026) · doi

  The paper identifies that RAG achieved 99% explicit citation rates but cannot determine whether the cited Pólya heuristics were actually accessed versus hallucinated by the LLM. Future work should develop verification mechanisms to distinguish between genuine knowledge retrieval and citation hallucination in RAG-based mathematics educational systems.

• Cluster Pattern Analysis of Students Stress using Machine Learning Algorithms with Feature Engineering (2026) · doi

  The three identified student stress clusters (high-risk with undesirable behaviors, moderate-risk, low-risk from stable families) are characterized qualitatively, but targeted intervention effectiveness has not been validated empirically. Future work should include longitudinal intervention studies measuring whether the recommended therapies and socialization strategies for each cluster actually reduce stress levels and improve retention in the identified student populations.

• Pre-service Teachers' Self-Directed Learning in a Blended Learning Environment: A Study on Scale Development and Affecting Factors (2026) · doi

  The SDL scale was validated exclusively at HNUE, one of seven key Vietnamese pedagogical universities; cross-cultural validation is needed across different countries and non-key institutional contexts to determine whether environmental and cultural differences significantly influence SDL levels in blended learning environments for pre-service teachers.

• Does “Maniplo-Spatial Arty” Really Work? A Study of the Effectiveness of “Maniplo-Spatial Arty” as a Teaching and Learning in Science Pedagogy (2026) · doi

  Of 68 remembered maniplo-spatial tasks, 27 (40%) were recalled primarily for distinctive sensory factors (visual, acoustic, olfactory) and 18 (26%) for unusual presentation contexts, yet no systematic comparison exists between learning outcomes for maniplo-spatial tasks with high sensory/contextual salience versus standard laboratory-based maniplo-spatial tasks matched for conceptual content.

• Quality Evaluation of Indonesian Student-generated User Stories: Insight from Human and ChatGPT Evaluation (2026) · doi

  ChatGPT achieved moderate-to-high agreement with human evaluators for structurally defined criteria but showed consistent lower agreement (55-65%) for context-dependent criteria like Unambiguous; future work must evaluate other AI models (beyond ChatGPT) and different prompting strategies to identify whether improved agreement for semantic user story quality assessment is achievable through model selection or instruction refinement.

• Washington University in St. Louis School of Medicine (2010) · doi

  While the paper mentions a sophisticated student-driven course evaluation system and collection of AAMC Matriculating and Graduation Questionnaires, USMLE exam performance, and residency director feedback, it does not describe specific psychometric validation studies or reliability/validity testing of these programmatic outcome measures across different student cohorts.

• Beyond the lab bench: Pathways in inclusion, equity, and diversity in biology education and social justice (2020) · doi

  The relationship between growth mindset interventions and persistence in STEM coursework for underrepresented minority undergraduates in biology has not been directly measured. Controlled studies comparing growth mindset cultivation approaches within the Interconnected Cycle of Reciprocity model against standard advising practices are needed to quantify their differential impact on retention and course performance.

• Research on the Teaching Model of AIGC-Empowered Interdisciplinary Competence Cultivation for Postgraduates in Biomedical Fields (2026) · doi

  The paper reports that the 'interdisciplinary integration degree' index increased by 31.5% in Biomass Energy Engineering and Technology course, but does not specify whether this improvement generalizes to other engineering and life science interdisciplinary postgraduate courses, limiting transferability claims.

• Johns Hopkins University School of Medicine (2010) · doi

  Virtual microscopy has been implemented for teaching cell physiology, histology, and pathology, but there is no documented comparison of diagnostic accuracy, learning efficiency, or long-term retention outcomes between students using virtual microscopy systems versus traditional light microscopy in the medical education building.

• Academic Medicine in a Transformational Time (2015) · doi

  The paper asserts that academic medicine should emphasize primary care training over specialties but provides no framework for measuring how curriculum redesign, faculty recruitment patterns, and institutional resource allocation affect medical school enrollment trends in primary care versus subspecialty tracks.

• The Effect of Videoscribe Media Assisted by the Guided Inquiry Learning Model on Students’ Physics Learning Outcomes (2026) · doi

  Although the paper demonstrates medium practical significance (Cohen's d = 0.731) for physics learning outcomes using Videoscribe with Guided Inquiry, it does not report long-term retention testing, transfer of learning to novel physics problems, or durability of conceptual understanding beyond the immediate posttest measurement.

• Wright State University Boonshoft School of Medicine (2010) · doi

  Team-Based Learning (TBL) has been implemented throughout BSOM's preclinical curriculum since 2002 as the first medical school to institute TBL schoolwide, yet the paper provides no longitudinal data comparing USMLE Step 1 and Step 2 performance, clinical clerkship grades, or residency program director evaluations between cohorts taught under TBL versus traditional lecture-based approaches to isolate TBL's causal impact on learning outcomes.

• MENCAPAI DEEP LEARNING MELALUI MODEL PENGOLAHAN INFORMASI:ANALISIS STRATEGI PENGUASAAN KONSEP TANPA SEKAT MATA PELAJARAN (2026) · doi

  While the paper asserts that differentiated learning strategies (differentiation in content, process, and product) are necessary for equitable deep learning achievement, there is no documented evidence comparing specific differentiation techniques and their effectiveness in enabling students with different learning readiness levels to achieve deep concept mastery within integrated subject-area curricula.

• Lifestyle Medicine at the University of Central Florida College of Medicine (2021) · doi

  While the paper establishes lifestyle medicine as a Longitudinal Curricular Theme at UCF COM, it does not specify mechanisms for evaluating whether embedded lifestyle medicine content across multiple courses produces measurable differences in student knowledge retention, clinical behavior change, or long-term practice patterns compared to traditional single-course instruction.

• University of Alabama School of Medicine (2010) · doi

  The Regional Campuses in Huntsville and Tuscaloosa reportedly offer a comparable curriculum to the Birmingham campus, but there are no specified benchmarks, equivalency measures, or systematic comparison data documented to validate curricular parity across the three geographic locations, particularly regarding basic science integration implementation.

• McGill University Faculty of Medicine (2010) · doi

  Student satisfaction surveys positively evaluated the simulation center's introduction across communication skills, procedural training (phlebotomy, intubation, foley catheter insertion), and OSCE examinations, but the paper does not report longitudinal skill retention data or comparative effectiveness of simulation-based versus bedside procedural training on actual clinical performance during clerkships.