Science AI Journal
Decision Sciences · Research topic

Open research questions in Psychometric Methodologies and Testing

1,476 gap statements mined from Psychometric Methodologies and Testing papers in our 7.9M-paper local library, which holds 10,556 papers on the topic — drawn mostly from each paper's own stated research gap, future-work, challenge and limitation notes, and its abstract. The ones listed below are a selection still marked open; each names the study that raised it, with a DOI link where the paper has one.

Choosing where to publish on Psychometric Methodologies and Testing? See the ranked Social Science journals.

What the literature leaves open

  • The need to ensure score reliability, classification decision accuracy, and interrater reliability of TOEFL Primary test scores. The lack of studies evaluating the internal consistency reliability and classification decision accuracy of TOEFL Primary test scores.

    Score Reliability, Classification Decision Accuracy, and Interrater Reliability of TOEFL Primary® Tests · 2026 · DOI

  • It highlights the need to investigate longitudinal invariance and local dependence of negatively worded items. The study addresses the gap by using complex-sample inference to quantify uncertainty.

    Measuring change in mathematics enjoyment: longitudinal invariance, local dependence of negatively worded items, and complex-sample inference · 2026 · DOI

  • The study only examined undergraduate students enrolled in an introductory psychology course. The study did not control for age, although it matched age-matched groups of university students. The study used a limited number of tasks to estimate semantic memory networks.

    Mapping the Memory Structure of High-Knowledge Students: A Longitudinal Semantic Network Analysis · 2024 · DOI

  • The lack of validation of the figural matrices test for use with both sexes. The need for a detailed analysis of the measurement properties of the items in the test. The importance of evaluating the impact of violations to measurement invariance on the estimated distribution parameters.

    Large-Scale Item-Level Analysis of the Figural Matrices Test in the Norwegian Armed Forces: Examining Measurement Precision and Sex Bias · 2024 · DOI

  • Further research could investigate the use of other psychometric approaches to identify examinee differences in strategies and understanding of test-taking procedures. Future studies could examine the effectiveness of the proposed method in different contexts and with different types of tests. Research could also explore the relationship between response processes and external relationships in more detail.

    Psychometric Modeling to Identify Examinees’ Strategy Differences during Testing · 2024 · DOI

  • The lack of consideration for sequential dependencies in item responses in the context of cognitive ability testing. The oversight of the potential influence of item sequences on test performance in traditional psychometric approaches. The need for more sophisticated psychometric models to ensure precise measurement and interpretation of progressive matrices tests.

    Modeling Sequential Dependencies in Progressive Matrices: An Auto-Regressive Item Response Theory (AR-IRT) Approach · 2024 · DOI

  • Traditional psychometric models assume conditional independence, which may not be reasonable. The Rasch model may not account for interactions between persons and items. There is a need for a model that can capture unexplained interactions between persons and items.

    A Recent Development of a Network Approach to Assessment Data: Latent Space Item Response Modeling for Intelligence Studies · 2024 · DOI

  • Prior work has employed clustering methods to analyze log data, but there is a need for biclustering methods to enable simultaneous classification of test takers and features extracted from log files. There is a lack of understanding of the behavioral patterns that can be uncovered from process data collected from computer-based complex problem-solving assessments.

    Biclustering of Log Data: Insights from a Computer-Based Complex Problem Solving Assessment · 2024 · DOI

  • Prior research focused on general patterns of conditional dependence, neglecting heterogeneity across respondents and items. The paper identifies the need to explore how individuals interact with items differently depending on their response times.

    Conditional Dependence across Slow and Fast Item Responses: With a Latent Space Item Response Modeling Approach · 2024 · DOI

  • The lack of effective methods for identifying the cause of low-quality items and devising revision plans. The limitation of existing explanatory CDMs in explaining CDM item parameters using item features. The need for a framework that incorporates item features to enhance the estimation of item parameters.

    Explanatory Cognitive Diagnosis Models Incorporating Item Features · 2024 · DOI

  • Machine learning (ML)-based scoring offers a scalable alternative, yet its psychometric consequences in rater-mediated models remain underexplored.

    Revisiting reliability with human and machine learning raters under scoring design and rater configuration in the many‐facet Rasch model · 2026 · DOI

  • Despite their appeal, key aspects of Bayesian estimation for these models remain understudied, including systematic comparison of prior specifications for the asymmetry parameter, model selection performance relative to symmetric alternatives, and application of modern convergence diagnostics.

    A Bayesian framework for the logistic positive exponent and its reflection IRT models · 2026 · DOI

  • We agree with Kaiser and Wilson's (2026) assessment that the underlying mechanisms of many well-known effects are understudied.

    Commentary to Kaiser and Wilson (2026) · 2026 · DOI

  • Second, we concur with Owen and Xu that a more expansive view of the history of testing is warranted.

    Methodological Rigor and Justice in Language Assessment: Correcting the Course A Response to Owen and Xu’s “Maintaining Methodological Rigor in Language Assessment: A Response to Randall et al.’s Justice-Oriented Antiracist Validity Framework” · 2026 · DOI

  • Rawls alone is insufficient; for that reason, in our research we place his work within a broader conversation that includes Iris Marion Young, Charles W.

    Methodological Rigor and Justice in Language Assessment: Correcting the Course A Response to Owen and Xu’s “Maintaining Methodological Rigor in Language Assessment: A Response to Randall et al.’s Justice-Oriented Antiracist Validity Framework” · 2026 · DOI

  • There is no theory justifying the use of simple and powerful tests in factor-augmented regression models with weaker loadings. The existing theory does not account for the empirically well-documented fact of homogeneously/heterogeneously weak factor loadings.

    New tests of equal forecast accuracy for factor-augmented regressions with weaker loadings · 2026 · DOI

  • A four-class solution was not attempted due to the decreasing significance levels and class sizes. The study only used a group of young adults in a laboratory with multiple computers. The study was limited to 301 military recruits who took ART and other tests on a voluntary basis.

    Psychometric Modeling to Identify Examinees’ Strategy Differences during Testing · 2024 · DOI

  • Investigating the reasons behind the decline in mathematics enjoyment across school years - Examining the relationship between mathematics enjoyment and academic achievement - Studying the impact of different educational systems on mathematics…

    Measuring change in mathematics enjoyment: longitudinal invariance, local dependence of negatively worded items, and complex-sample inference · 2026 · DOI

  • Further research could explore the application of biclustering to other tasks and assessments, - Further research could investigate the use of other biclustering algorithms, - Further research could examine the relationship between biclustering and other analytical…

    Biclustering of Log Data: Insights from a Computer-Based Complex Problem Solving Assessment · 2024 · DOI

  • The issue lies not in the approach itself but rather in the limited development of psychometric models that realistically reproduce the inherent complexity of real data, - Only a few instruments have been developed under this approach, - The LLTM has unidimensional…

    Delving into the Complexity of Analogical Reasoning: A Detailed Exploration with the Generalized Multicomponent Latent Trait Model for Diagnosis · 2024 · DOI

  • Developing more psychometric models that realistically reproduce the inherent complexity of real data, - Exploring the application of the GMLTM-D in other domains, - Investigating the use of the GMLTM-D in calibrating intelligence…

    Delving into the Complexity of Analogical Reasoning: A Detailed Exploration with the Generalized Multicomponent Latent Trait Model for Diagnosis · 2024 · DOI

  • The absence of established benchmarks for evaluating model and item fit for these novel item response models, - The need for further research to establish benchmarks for evaluating the fit of these innovative models, - The study did not provide a comprehensive comparison with traditional…

    A Comparative Study of Item Response Theory Models for Mixed Discrete-Continuous Responses · 2024 · DOI

  • Establishing benchmarks for evaluating the fit of these innovative models, - Further research on the application of these models in real-world scenarios, - Investigating the use of other machine learning and AI-driven technologies in language proficiency…

    A Comparative Study of Item Response Theory Models for Mixed Discrete-Continuous Responses · 2024 · DOI

  • Future research directions are discussed, - The proposed models could be applied to other datasets, - Further studies could investigate the relationships between item features and other item…

    Explanatory Cognitive Diagnosis Models Incorporating Item Features · 2024 · DOI

  • Discussions related to the latent space modeling integrated with other psychometric models, - Potential future…

    A Recent Development of a Network Approach to Assessment Data: Latent Space Item Response Modeling for Intelligence Studies · 2024 · DOI

Most-cited papers in Psychometric Methodologies and Testing

Most recent work

Find a gap in your own Psychometric Methodologies and Testing sub-topic

This page shows what the Psychometric Methodologies and Testing literature already flags as unresolved. To narrow it to your specific question, search the Research Gap Finder: the search is free with a free account and lists the papers closest to your topic first. Unlocking that topic (50 credits, charged once) fills the comparison table from our 7.9M-paper local library and writes the gaps from its rows.

Open the Research Gap Finder →

Related topics in Decision Sciences

scientometrics and bibliometrics research
1,008 open questions
Technology Adoption and User Behaviour
880 open questions
Evaluation and Performance Assessment
686 open questions
Decision-Making and Behavioral Economics
546 open questions
Construction Project Management and Performance
507 open questions
Meta-analysis and systematic reviews
446 open questions
Ethics in Business and Education
400 open questions
Stock Market Forecasting Methods
326 open questions
Open questions raised by papers listed on this page include: (1) The lack of studies evaluating the internal consistency reliability and classification decision accuracy of TOEFL Primary test scores (“Score Reliability, Classification Decision Accuracy, and Interrater Reliability…”, 2026); (2) Machine learning (ML)-based scoring offers a scalable alternative, yet its psychometric consequences in rater-mediated models remain underexplored (“Revisiting reliability with human and machine learning raters under scoring…”, 2026); (3) There is no theory justifying the use of simple and powerful tests in factor-augmented regression models with weaker loadings (“New tests of equal forecast accuracy for factor-augmented regressions with…”, 2026); (4) The lack of validation of the figural matrices test for use with both sexes (“Large-Scale Item-Level Analysis of the Figural Matrices Test in the Norwegian…”, 2024); (5) Further research could investigate the use of other psychometric approaches to identify examinee differences in strategies and understanding of test-taking procedures (“Psychometric Modeling to Identify Examinees’ Strategy Differences during Testing”, 2024). 1,476 gap statements have been mined from Psychometric Methodologies and Testing papers in our 7.9M-paper local library, which holds 10,556 papers on the topic; the gaps come from whichever of those papers state one. They are mostly the research gaps the authors state and the papers' abstracts, plus future-work, limitations and challenges passages. The ones listed below are a selection still marked open; each names the study that raised it, with a DOI link where the paper has one, so you can read the original claim in context.

Tools for your next paper

Gaps & Literature SearchFind open questions in any field — 1,100,000+ open gaps mined from our own library.Pre-CheckIs your paper ready? Acceptance odds for top, mid and open/emerging journals, in seconds.Journal FinderA ranked shortlist of target journals from a 17,500-venue index.Duplicate Publication CheckerCheck for prior publication across 7 sources and our local library.Citation GeneratorFreeA DOI or title → APA, MLA, Vancouver, Chicago, BibTeX, RIS. No signup.Graphical Abstract MakerFreeTurn your findings into a colorblind-safe graphical abstract.

How Pre-Check worksHow AI Review works

Compare the category — Honest roundups of the AI research tools, ours listed alongside the alternatives.

Command palette

Jump anywhere, run any action.