Open research questions in Gaussian Processes and Bayesian Inference
86 unresolved questions extracted from the limitations and future-work sections of 407 Gaussian Processes and Bayesian Inference papers in our library. Each links back to the study that raised it.
What the literature leaves open
Further development of the proposed approaches to improve predictive accuracy and predictive coverage. Application of the approaches to various fields, including hydrology and systems biology.
The simulation model is itself an imperfect approximation of real-world processes. The lack of integration of simulation data and real-world measurement data during surrogate training.
High cost of high-quality reference sensors. Limited number of sensors that can be deployed. Need for accurate spatial mapping of pollutant concentrations.
Efficient Uncertainty-Guided Sensor Placement for Air Quality Mapping using Gaussian Processes and Spatial Indexing · 2026 · DOIThe curse of dimensionality. The need for a method that can approximate complex distributions. The need for a method that can achieve faster convergence rates than standard Monte Carlo.
The optimization of the latent factor matrix in the Stiefel manifold in each step of the optimization can be unstable. The numerical optimization in high-dimensional parameter space can be unstable.
Fast Data Inversion for High-Dimensional Ornstein–Uhlenbeck Processes from Noisy Measurements · 2026 · DOIThe presence of an unknown multiplicative constant. The non-negligible computational cost of evaluating the likelihood. The high dimensionality of the parameter space.
Estimating intractable posterior distributions through Gaussian process regression and metropolis-adjusted Langevin procedure · 2026 · DOIThe uncertainty of reservoir properties severely compromises the predictive accuracy of subsurface flow dynamics. Existing inversion methods require adaptation for each new observational configuration.
SURGIN: SURrogate-guided Generative INversion for subsurface multiphase flow with quantified uncertainty · 2026 · DOIThe approach requires the choice of a shrinkage strength parameter m. The paper discusses the sensitivity of the results to the choice of m. The approach is limited to the analysis of a single sector or outcome.
Bayesian-smoothed location quotients for small regions with credible intervals and specialisation probabilities · 2026 · DOIFuture research can explore the application of the approach to other fields, including spatial epidemiology and disease mapping. Future research can investigate the use of different prior distributions and models. Future research can examine the sensitivity of the results to different choices of the shrinkage strength parameter m.
Bayesian-smoothed location quotients for small regions with credible intervals and specialisation probabilities · 2026 · DOIFuture research should focus on extending the proposed strategy to other types of machine learning models, such as support vector machines and random forests. Future research should focus on applying the proposed strategy to other engineering applications, such as materials science and computer vision. Future research should focus on improving the efficiency and scalability of the proposed strategy.
The research gap is the need for a practical multi-fidelity machine learning strategy that combines deterministic and Bayesian models. The research gap is the need for a strategy that can address the accuracy-efficiency trade-off in machine learning. The research gap is the need for a strategy that can be used in a variety of engineering applications.
Future research can explore the application of the γ-Stein operator to larger datasets. The method can be extended to other types of probability models.
The paper identifies the need for robust inference with unnormalized probability models. The current methods can be sensitive to outliers and data contamination.
Future research should investigate the performance of lazyHMC on large-scale problems. Future research should investigate the application of lazyHMC to other domains, such as computer vision and natural language processing.
LazyHMC: Hamiltonian Monte Carlo Simulation for Lazy, Infinite Dimensional Probabilistic Programs · 2026 · DOIThe paper identifies a gap in the existing literature on probabilistic programming, which is the lack of a formulation of HMC that can handle infinite-dimensional parameter spaces. The paper identifies a gap in the existing literature on HMC, which is the need for a formulation that can handle lazy evaluation.
LazyHMC: Hamiltonian Monte Carlo Simulation for Lazy, Infinite Dimensional Probabilistic Programs · 2026 · DOILimited onboard computation. Privacy requirements. Communication bandwidth constraints.
Federated Gaussian Process Learning via Pseudo-Representations for Large-Scale Multi-Robot Systems · 2026 · DOIStrong process nonlinearity. Limited evaluation budgets. Strict operational constraints.
Risk-sensitive collaborative parameter tuning via calibrated deep surrogates for rare-earth electrolysis energy efficiency · 2026 · DOIExpensive computer simulations - Heteroscedastic stochastic simulations - Limited computational budgets
Counterexamples show that terminal $W_4$ convergence alone is insufficient for variance consistency.
Diffusion Bootstrap for High-Dimensional Linear Models · 2026Bayesian calibration of material constitutive parameters from multimodal mechanical test data is often limited by the need to specify a joint likelihood across measurement modalities that differ in dimensionality, noise structure, and physical units.
Amortized Posteriors for Estimation of Material Constitutive Parameters from Multimodal Measurements on Small Punch Tests · 2026Alternative distributions have been proposed for the prior specifically, while the effect of distribution choice on the likelihood distribution remains unexplored.
Rethinking Likelihood distributions: Student's t Likelihood Boosts Bayesian Neural Network Performance · 2026The computational challenges associated with prior-free possibilistic statistical inference. The lack of efficient methods for approximating the possibilistic output of inferential models.
An efficient Monte Carlo method for valid prior-free possibilistic statistical inference · 2026 · DOIValidation on real urban data. Investigation of batch Bayesian optimization for global designs. Development of adaptive sensing strategies for real-time air quality monitoring.
Efficient Uncertainty-Guided Sensor Placement for Air Quality Mapping using Gaussian Processes and Spatial Indexing · 2026 · DOIExisting automated approaches struggle in high dimensions for two bottlenecks: their kernel search space is limited to additions and multiplications of base kernels, and LLM-based approaches require conditioning on raw observations, which becomes infeasible due to context-length limits and the difficulty of extracting meaningful patterns.
Automated Kernel Discovery Towards Understanding High-dimensional Bayesian Optimization · 2026The method assumes a fixed set of participating agents. The experiments are limited to synthetic and real-world datasets with fleet sizes from 16 to 100 agents.
Federated Gaussian Process Learning via Pseudo-Representations for Large-Scale Multi-Robot Systems · 2026 · DOI
Most-cited papers in Gaussian Processes and Bayesian Inference
- Markov Chain Monte Carlo: Can We Trust the Third Significant Figure? · Statistical Science · 2008 · 254 citations
- A General Framework for Vecchia Approximations of Gaussian Processes · Statistical Science · 2020 · 170 citations
- Auto-Encoding Variational Bayes · Cambridge Explorations in Arts and Sciences · 2024 · 93 citations
- The use of an unsupervised learning approach for characterizing latent behaviors in accelerometer data · Ecology and Evolution · 2016 · 73 citations
- Generalized Additive Models · Annual Review of Statistics and Its Application · 2024 · 69 citations
- Likelihood-Free Parameter Estimation with Neural Bayes Estimators · The American Statistician · 2023 · 50 citations
- Analyzing Stochastic Computer Models: A Review with Opportunities · Statistical Science · 2022 · 47 citations
- Challenges in Markov Chain Monte Carlo for Bayesian Neural Networks · Statistical Science · 2022 · 42 citations
- Training Physics‐Based Machine‐Learning Parameterizations With Gradient‐Free Ensemble Kalman Methods · Journal of Advances in Modeling Earth Systems · 2022 · 40 citations
- The Matérn Model: A Journey Through Statistics, Numerical Analysis and Machine Learning · Statistical Science · 2024 · 32 citations
Most recent work
- A Primer on Bayesian Neural Networks: Review and Debates · Statistical Science · 2026
- An efficient Monte Carlo method for valid prior-free possibilistic statistical inference · Journal of the American Statistical Association · 2026
- Auto-marking short answer questions in science: The foundational years of transformer-based models from BERT to GPT-4 · International Journal of Artificial Intelligence in Education · 2026
- A Fourier-Based Inference Method for Learning Interaction Kernels in Particle Systems · SIAM Journal on Applied Mathematics · 2026
- Error analysis of parameter prediction via Gaussian process regression and its application to weighted Jacobi iteration · Computational and Applied Mathematics · 2026
- Study, Implementation, and Application of the Bivariate Cosine Gaussian Distribution · Earthline Journal of Mathematical Sciences · 2026
- Exact Bayesian Gaussian Cox Processes Using Random Integrals · SIAM Journal on Mathematics of Data Science · 2026
- Robust Variational Gaussian Process Regression for Count Data with the Trimmed Marginal Likelihood · Statistics and Computing · 2026
- Bayesian surrogate training on multiple data sources: a hybrid modeling strategy · Statistics and Computing · 2026
- Efficient Uncertainty-Guided Sensor Placement for Air Quality Mapping using Gaussian Processes and Spatial Indexing · Zenodo (CERN European Organization for Nuclear Research) · 2026
Find a gap in your own Gaussian Processes and Bayesian Inference sub-topic
This page shows what the Gaussian Processes and Bayesian Inference literature already flags as unresolved. To narrow it to your specific question, run the guided finder — it searches the gap library on demand and checks candidates against 250M+ OpenAlex works.
Open the Research Gap Finder →