Validation gaps in Computer Science

Representative open questions

Showing 30 of 319 — one per source paper, highest-quality first.

• Federated learning for privacy-preserving skin cancer classification using deep neural networks (2026) · doi

  The model's performance on the ISIC dataset is evaluated using various metrics (accuracy, AUC, F1-score), but the robustness of these metrics to different conditions (e.g., varying image quality) is not assessed.

• Securing IoT Devices with PUFs: Mitigating Aging and Tampering through Cryptography and Machine Learning (2026) · doi

  The condition N minπi ≥ 5 for χ² approximation validity is stated, but no empirical testing is provided to determine whether this conservative condition remains sufficient for IoT PUF sequences with reduced entropy due to aging-induced bit-flip rates or tampering-induced environmental stress.

• Blockchain-integrated machine learning framework for transparent smart contract vulnerability detection (2026) · doi

  The SmartBugs-Wild dataset evaluation revealed highly skewed cluster distributions (35,499 contracts in Cluster 1 vs. 149 in Cluster 2) with only 34.15% variance explained by the first two principal components, yet the impact of this structural heterogeneity on model generalization across clusters has not been evaluated. Cross-cluster validation performance between models trained on different structural archetypes of smart contracts should be investigated.

• Can deep learning-based segmentation and classification improve the detection of renal cortical abnormalities? (2026) · doi

  Although Grad-CAM visualizations confirm the DenseNet205 model focuses on cortical scarring regions, the paper does not compare the localization accuracy of model activations against radiologist-annotated scar boundaries or validate whether the model's attention patterns align with clinically significant scarring thresholds. Quantitative analysis of Grad-CAM activation overlap with expert scar delineations is needed for clinical acceptance.

• Inferring High-Dimensional Dynamic Networks Changing with Multiple Covariates (2026) · doi

  The paper identifies that TP53 exhibits unclear connection patterns with several genes (ATG4A, RAD9B, STX6, TRIM13, XRCC4, CES2, SESN2, FBXO22, XRCC6, GRB2, PRKAA1, TAF3, NOX4) across cancer groups and radiation doses, but provides no mechanistic validation of these radiation dose-dependent network rewiring patterns through experimental confirmation or functional genomics approaches.

• COGNITIVE INFRASTRUCTURE AND THE RECURSIVE TRANSFORMATION OF KNOWLEDGE COMMUNICATION: GENERATIVE AI IN SCIENTIFIC PUBLISHING (2026) · doi

  The paper argues that certification mechanisms are exposed as inadequate when generative systems enter writing and evaluation, triggering an arms-race dynamic where detection tools stimulate further innovation in generative capability. However, it does not characterize the specific failure modes of current integrity detection methods against evolving AI text generation techniques or provide benchmarks for measuring detection evasion rates across different manuscript types and disciplinary norms.

• Prediction of sedimentation concentration profiles in inclined suspension systems: A data-driven neural network framework (2026) · doi

  The ANN model was trained and tested exclusively within a single experimental domain (glycerin–water 92% v/v, glass microspheres 212–800 µm, 20% v/v solids), meaning high accuracy reflects interpolation rather than extrapolation; generalization to other rheologies, particle morphologies, volumetric concentrations, or field-scale conditions in inclined suspension systems remains untested.

• Large language model based machine translation for universal multilingual understanding and translation quality enhancement (2026) · doi

  The paper evaluates machine translation quality using multiple metrics (BLEU, COMET, BERTScore) but does not systematically analyze which metrics best correlate with human judgment for different language pairs or establish metric-specific performance trends for universal multilingual understanding and translation quality assessment.

• Leveraging machine learning to enhance aerosol classification using Single-Particle Mass Spectrometry (2026) · doi

  While the dataset contains 18,827 labeled spectra across 20 aerosol types, generalization performance of the machine learning framework on SPMS measurements from different atmospheric environments, seasons, or geographic locations has not been evaluated. Cross-dataset validation is needed to assess whether the supervised and semi-supervised models maintain classification fidelity for soot and feldspars across diverse real-world deployment scenarios.

• Quantum Information Framework for Neural Network Generalization: A Comprehensive Experimental Analysis (2026) · doi

  Training is conducted with a single optimizer (Adam) and fixed hyperparameter ranges (learning_rate=0.01, weight_decay=0.0); the effect of different optimization algorithms and regularization intensities on quantum information metrics and their correlation with generalization remains untested.

• AI in Cybersecurity: A Systematic Review and Conceptual Audit Model (2026) · doi

  The model claims to balance AI-driven technology adoption with adequate cybersecurity safeguards, yet provides no validation dataset, benchmark, or test cases demonstrating how organizations with different maturity levels, infrastructure complexity, or resource constraints should implement the Anti-Sheriff framework operationally.

• Explainable machine learning for tracking spatial variation in leaf chlorophyll fluorescence within temperate deciduous forest canopies (2026) · doi

  The Random Forest and XGBoost models for predicting chlorophyll fluorescence parameters were trained exclusively on temperate deciduous forest datasets. These models require retraining and validation across diverse ecosystems (croplands, grasslands, wetlands) to assess transferability and determine whether spectral reflectance-ChlF relationships remain consistent across different plant functional types and canopy architectures.

• Machine-learning-based reconstruction of Ming-dynasty defensive corridors in Yuxian (2026) · doi

  The paper validates defense corridors against 181-232 military defense sites using buffer coverage analysis (72-83% coverage at 2-5 km), but does not evaluate model performance using other validation metrics (precision, recall, F1-score), cross-validation across temporal periods (early vs. late Ming), or compare predictions against archaeologically-excavated versus documented-only heritage sites.

• Comparative analysis of deep learning algorithms for rolling element bearing fault classification under variable loads and speeds (2026) · doi

  The robustness analysis used purely additive white Gaussian noise at 1 dB, 3 dB, and 5 dB SNR levels, but this does not represent the full range of mechanically-induced disturbances in industrial bearing systems such as load torque ripple, rotational speed fluctuation, structural resonance, or shaft misalignment. Future work should evaluate deep learning models for rolling element bearing fault classification under these realistic non-stationary mechanical phenomena with frequency drift, harmonic amplification, and impulsive components.

• The adoption of artificial intelligence methods in entrepreneurship research: current state and pathways forward (2026) · doi

  The cascading term substitution problem in VOSviewer—where excluding multi-word terms causes shorter term variants to capture occurrences of excluded terms (e.g., 'artificial neural network' → 'neural network' → 'network')—is identified but lacks systematic evaluation of how this substitution cascade distorts co-occurrence networks and clustering in entrepreneurship AI literature reviews.

• A two-stage deep learning model for risk identification in green supply chain finance (2026) · doi

  The GAN-SAE synthetic data augmentation component is applied to the training set, but the paper does not report how synthetic data quality or distribution fidelity affects model robustness when applied to out-of-sample industries in the 2021-2024 external validation; ablation studies isolating GAN contribution versus SAE feature extraction are needed for green supply chain finance applications.

• LLM-Powered Silent Bug Fuzzing in Deep Learning Libraries via Versatile and Controlled Bug Transfer (2026) · doi

  TransFuzz's oracle validation achieves 71.42% precision due to three specific failure modes: (1) oracle design errors causing logical flaws in bug classification, (2) code migration failures that fail to preserve bug characteristics across different PyTorch APIs, and (3) insufficient API documentation leading to LLM misjudgment. These sources of false positives (28.58% rate) require targeted improvements in oracle construction and API information enrichment for silent bug detection in deep learning libraries.

• Quantum-SpinalNet: a hybrid deep learning approach for mammographic breast cancer detection (2026) · doi

  The attention map validation mentioned in section 5.4 is not detailed in the excerpt. The paper should specify how attention maps from the Q-SpinalNet were clinically validated against radiologist annotations to ensure that highlighted regions correspond to actual tumor boundaries and suspicious features rather than spurious artifact activations.

• Ocean: Object-aware Anchor-free Tracking with Matching-relation Learning (2026) · doi

  While Ocean++ is adapted to pixel-level tracking on VOT-2020 by grafting a segmentation network branch, the integration strategy and potential conflicts between the matching-relation learning mechanism and pixel-level segmentation requirements are not discussed or evaluated.

• Automated design of heuristics for resource-constrained project scheduling problem via regression algorithms (2026) · doi

  The CPU time comparison between regression-based heuristics (executed on standard desktop) and the genetic algorithm (executed on HPC system with parallel computing) is acknowledged as non-comparable. A controlled computational benchmark under identical hardware and parallel processing conditions is needed to definitively establish the computational efficiency claims of regression-based heuristics versus GA-based methods for large resource-constrained project scheduling.

• From unstructured text to structured reasoning: a hybrid knowledge graph for Indonesian sentencing analysis (2026) · doi

  The relevance filtering stage uses SMOTE oversampling to achieve 100% recall and 99.30% precision, but the paper does not evaluate whether this extreme precision-recall trade-off introduces cascading errors in downstream entity extraction when applied to court decisions with novel or unusual sentence structures not represented in the training set.

• Neural Network Tools in the Arsenal of a University Teacher (2026) · doi

  The paper states that AI tool effectiveness depends on user competency but does not empirically investigate or measure how different levels of user expertise in AI-assisted literature search (query formulation, result validation, critical evaluation) affect the quality outcomes when using neural network-based research tools in academic settings.

• Predicting Employee Attrition: A Machine Learning Approach in Human Resource Analytics (2026) · doi

  The paper demonstrates that Logistic Regression outperforms ensemble methods on the structured IBM HR Analytics Attrition Dataset, but does not validate whether this finding generalizes to organizations with unstructured HR data, different industry sectors, or datasets with varying class imbalance ratios beyond the current imbalanced attrition scenario.

• Enhancing Breast Cancer Diagnosis through Machine Learning: A Robust Approach for Early Detection (2026) · doi

  The breast cancer diagnosis models demonstrated overfitting on the Wisconsin Breast Cancer Dataset (WBCD), particularly Decision Trees and Gradient Boosting models. The generalizability of these machine learning models to new clinical cases with diverse patient demographics and different imaging protocols remains unvalidated beyond the tested datasets.

• GaussianSeal: Rooting Adaptive Watermarks for 3D Gaussian Generation Model (2026) · doi

  The paper reports fine-tuning attack robustness results (Table 13) showing bit accuracy degradation from 96.88% at 20 steps to 89.84% at 100 steps for 3DGS watermarking, but does not investigate the relationship between fine-tuning intensity, learning rate schedules, and watermark persistence. Systematic analysis of how different optimization strategies affect watermark robustness in 3D generative models is absent.

• Scour depth prediction using machine learning and explainable AI: assessment of bridge vulnerability (2026) · doi

  Although SHAP dependency analysis confirmed that model predictions are physically consistent with scour formation processes (wider piers and higher velocities cause more scour, coarser sediments reduce scour), the paper does not validate whether SHAP interpretability outputs remain reliable for extrapolation beyond the training dataset's hydraulic parameter ranges.

• A Motion-Based Compression and Tracking System for Video Camera Trap-Based Insect Behaviour Studies (2026) · doi

  The behavioral analysis validation (Table 4) demonstrated 97.5% track extraction and 93.6% flower visit extraction from compressed videos compared to raw videos, but the sensitivity of Polytrack's preprocessing and trajectory reconstruction steps to varying compression ratios and motion detection thresholds has not been systematically analyzed. The relationship between compression parameters and behavioral metric accuracy across different insect species and environmental conditions requires explicit characterization.

• A general framework for Gaussian Splatting-based human-centric volumetric videos (2026) · doi

  Cross-frame correspondence mechanisms for Gaussian Splatting volumetric video—such as establishing temporal correspondences between Gaussians, representing static regions as shared point sets, or adapting video encoding concepts like motion vectors to Gaussian trajectories—have not been systematically explored or validated for their impact on compression rates, streaming bandwidth, and temporal consistency.

• Minimum Stable Cut and Treewidth (2026) · doi

  The algorithm achieving ∆^O(tw)n^O(1) runtime for UNWEIGHTED MIN STABLE CUT via tree decomposition (Corollary 15) has not been empirically evaluated on real-world graphs with varying treewidth and maximum degree parameters to assess practical efficiency compared to baseline approaches.

• Sensor Data Fusion in Healthcare Monitoring System with Appropriate Rule-based Model for Error Reduction (2026) · doi

  Although the fused system achieved 100% data completeness and 36 dB signal-to-noise ratio, the paper does not compare the ORSF-HMM-SDL model against other sensor fusion techniques (Kalman Filter, SVM, Deep Learning Fusion are mentioned in Table 6 but not thoroughly evaluated against the proposed method).