Open research questions in Human Pose and Action Recognition
143 gap statements mined from Human Pose and Action Recognition papers in our 4.5M-paper local library, which holds 1,317 papers on the topic — drawn mostly from each paper's own stated research gap, future-work, challenge and limitation notes, and its abstract. The ones listed below are a selection still marked open; each names the study that raised it, with a DOI link where the paper has one.
Choosing where to publish on Human Pose and Action Recognition? See the ranked Computer Science journals.
What the literature leaves open
Future studies will focus on lightweight ViTs, multimodal data fusion, and self-supervised learning to facilitate the implementation of these approaches in various areas, including smart surveillance, healthcare monitoring, AR/VR interfaces, and human-robot collaboration in smart environments.
To address this limitation, future work will focus on expanding the dataset to include a broader spectrum of postures and gestures and on exploring more advanced learning strategies to improve robustness and generalization.
There is a lack of study on using real-time surveillance cameras to identify armed individuals. Current systems rely on human supervision, which can be ineffective.
Real-Time Detection of Armed Individuals in Video Surveillance Using Machine Learning Techniques · 2026 · DOIReal-time human action recognition deployment in Internet of Things environments remains limited by latency, bandwidth, and the tradeoff between model size and performance.
Skeleton-Based Human Action Recognition Using Multitype Input Data on Edge Devices in Internet of Things Systems · 2026 · DOIThe risk of suffering from injuries due to lack of professional training. The need for real-time exercise form monitoring and corrective capabilities. The requirement for automated systems that can analyze human body movements.
AI Fitness Coach : Real-Time Exercise Posture Correction Using MediaPipe Pose Estimation and Voice Guidance · 2026 · DOIThe need for innovative solutions to master yoga poses, particularly for beginners lacking access to experienced instructors. The lack of lightweight and efficient models that can provide accurate pose estimation while conserving computational resources.
Using the current design, several methods may be used to further enhance the system, including: Real-Time Correction and Feedback: Customers can get real-time feedback by integrating posture correction assistance with biomechanical angle analysis. Develop lightweight transformers or quantized models that may be used on wearables and mobile devices to optimize edge deployment.
Hybrid vision–IMU deep learning framework with graph convolutional networks and attention for personalized yoga posture identification · 2026 · DOIThe need for trustworthy AI systems to support caregivers in kindergartens. The lack of effective monitoring systems for ensuring child safety.
Real-Time Monitoring of Kindergarten Safety Using YOLO-11-Based Detection of Children and Adults · 2026 · DOIFuture research directions include supporting more complex interaction dynamics involving multiple objects and multi-agent settings. Future research directions include addressing the limitations of the simulator, such as modeling social or collaborative scenarios.
EgoInteract: Synthetic Egocentric Videos Generation for Interaction Understanding and Anticipation · 2026The research gap is the lack of large-scale egocentric video datasets with dense spatial and temporal annotations. The research gap is the limited coverage of interaction dynamics in existing datasets, hindering the generalization of models across tasks and scenarios.
EgoInteract: Synthetic Egocentric Videos Generation for Interaction Understanding and Anticipation · 2026Joint object-hand modeling and end-to-end training are natural next steps. Applying the quality-aware flow-matching framework to other domains with similar challenges.
StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Video · 2026The system requires a custom exoskeleton backpack and Apple Vision Pro for markerless hand tracking. The dataset is limited to 10K teleoperated episodes and 2.92M frames.
Dexora: Open-source VLA for High-DoF Bimanual Dexterity · 2026Future work should examine model compression techniques, efficient quantization, lightweight model structures, and energy-aware training procedures to ensure the hybrid model remains practical for ubiquitous deployment.
KAN-MLP-Mixer: A comprehensive investigation of the usage of Kolmogorov-Arnold Networks (KANs) for improving IMU-based Human Activity Recognition · 2026The model is not evaluated for real-time pose tracking or monocular 3D human pose estimation. The dataset used is limited to MS COCO 2017.
The literature on HAR is vast, but researchers face challenges in selecting optimal architectures and models. There is a need for a comprehensive review of HAR methods to identify the best performing models.
Current supervised learning methods are bound by the availability of labeled data, restricting them to laboratory environments. The model may not generalize to real-world or previously unseen movements. The dataset is limited to 10 participants. The model is restricted to a sagittal-plane lower limb model.
Current real-time methods rely on supervised learning, which requires ground truth datasets measured with laboratory measurement systems. These systems introduce measurement and processing errors and often fail to generalize to real-world movements. There is a need for a method that can accurately estimate human movement dynamics without requiring labeled training data.
The system requires users to complete their workouts while being filmed by cameras. The system does not need advanced GPUs but uses Python computer vision libraries. Future enhancements will enable the system to support more advanced exercises.
AI Fitness Coach : Real-Time Exercise Posture Correction Using MediaPipe Pose Estimation and Voice Guidance · 2026 · DOILimited accuracy of standard head pose benchmarks for head acceleration event conditions. Difficulty in estimating head pose during large, multi-axis rotations.
The dataset was limited to 10 participants. The study did not evaluate the models on other types of head acceleration events.
The difficulty of obtaining large amounts of labeled data for supervised skeleton-based action recognition. The limitation of simple late fusion in enhancing performance while maintaining model efficiency.
Multimodal Skeleton-based Action Representation Learning via Decomposition and Composition · 2026 · DOIExisting methods uniformly condition on noisy hand motion observations without accounting for their per-frame reliability. The egocentric capture setting poses significant challenges for recovering the world space 4D motion signal.
StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Video · 2026Extending Dexora to more complex tasks and domains. Improving the robustness and generalization of the system. Exploring the application of Dexora to various fields, including robotics, manufacturing, and healthcare.
Dexora: Open-source VLA for High-DoF Bimanual Dexterity · 2026The absence of posture analysis in existing fitness applications - The lack of real-time corrective feedback in existing fitness applications - The dependence on wearable devices in existing fitness…
Extending the temporal context to 15-30 seconds to improve recall for subtle categories. Incorporating trajectory history to improve detection accuracy. Developing more accurate suspicious behavior detection systems using the proposed SUSP-POSE dataset.
Construction and Benchmarking of a Dataset for Human Pose Estimation of Suspicious Behavior in Outdoor Environments · 2026 · DOI
Most-cited papers in Human Pose and Action Recognition
- OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2021 · 3,894 citations
- Real-time human pose recognition in parts from single depth images · Communications of the ACM · 2013 · 1,205 citations
- Human Action Recognition and Prediction: A Survey · International Journal of Computer Vision · 2022 · 563 citations
- Constructing Stronger and Faster Baselines for Skeleton-Based Action Recognition · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2022 · 468 citations
- Human Action Recognition From Various Data Modalities: A Review · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2022 · 439 citations
- Rescaling Egocentric Vision: Collection, Pipeline and Challenges for EPIC-KITCHENS-100 · International Journal of Computer Vision · 2021 · 402 citations
- Deep 3D human pose estimation: A review · Computer Vision and Image Understanding · 2021 · 396 citations
- Video-LLaVA: Learning United Visual Representation by Alignment Before Projection · 2024 · 365 citations
- Survey on Emotional Body Gesture Recognition · IEEE Transactions on Affective Computing · 2021 · 333 citations
- Skeleton-based action recognition via spatial and temporal transformer networks · Computer Vision and Image Understanding · 2021 · 326 citations
Most recent work
- Enhancing vision-based traffic crash detection performance consistency across day-night scenes: A depth-aware and domain-adaptive network · Accident Analysis & Prevention · 2026
- Spatio-Temporal Decoupled Knowledge Compensator for Few-Shot Action Recognition · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026
- Spatial–Temporal Self-Compensating Graph Convolutional Network for Skeleton-Based Action Recognition Under Data Constraints · IEEE Transactions on Image Processing · 2026
- Self-Supervised Skeleton-Based Action Representation Learning: A Benchmark and Beyond · International Journal of Computer Vision · 2026
- Fully integrated AI-enhanced flexible wearable sensor for real-time movement evaluation and table tennis training · Biosensors and Bioelectronics · 2026
- A Decade of Action Quality Assessment: Largest Systematic Survey of Trends, Challenges, and Future Directions · International Journal of Computer Vision · 2026
- A comprehensive survey of action quality assessment: Method and benchmark · Pattern Recognition · 2026
- Human Motion Prediction via Continual Prior Compensation · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026
- Exploring multi-transformer with fine-grained prompt-driven coupled with diffusion model for 3D human pose estimation · Multimedia Systems · 2026
- A Survey on Interpretability in Visual Recognition · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026
Find a gap in your own Human Pose and Action Recognition sub-topic
This page shows what the Human Pose and Action Recognition literature already flags as unresolved. To narrow it to your specific question, search the Research Gap Finder: the search is free with a free account and lists the papers closest to your topic first. Unlocking that topic (50 credits, charged once) fills the comparison table from our 4.5M-paper local library and writes the gaps from its rows.
Open the Research Gap Finder →