Open research questions in Wireless Signal Modulation Classification

What the literature leaves open

• Accurate modulation classification is crucial for efficient signal processing. The paper highlights the challenges of modeling temporal sequences in modulation classification. The paper identifies the need for robust models that can generalize well to higher SNRs.

  Design of a deep learning-based framework for automatic modulation classification in wireless communication systems using neural networks · 2026 · DOI

• Future research should focus on improving the model’s robustness in low SNR scenarios, and use another noise, such as Rayleigh noise and Rician noise, perhaps through techniques such as data augmentation, advanced noise filtering, transformer, attention mechanism, or more sophisticated deep learning architectures.

  Powerful deep convolutional neural networks for robust automatic modulation classification using spectrograms · 2026 · DOI

• The need to prevent the loss of key semantic information in multi-task scenarios under channel constraints.

  Research on Multi-Agent Semantic Communication Framework Based on Comparative Learning Joint Optimization · 2026 · DOI

• A more complete characterization of information propagation modes would strengthen the foundation of InfoFlow. Extending InfoFlow to practical Transformer variants is an important open problem.

  InfoFlow: A Framework for Multi-Layer Transformer Analysis · 2026

• The approximation theory of multi-layer Transformers remains largely open. The analytical techniques developed for the single-layer case do not extend directly to multi-layer settings.

  InfoFlow: A Framework for Multi-Layer Transformer Analysis · 2026

• Future research can focus on evaluating the proposed approach under more diverse scenarios and modulation formats. The study's findings can be extended to other wireless communication systems and applications.

  Enhancing OFDM Channel Estimation Accuracy with CNN-LSTM Hybrid Architectures · 2026 · DOI

• The gap in existing methods is their inability to fully capture joint spatial and temporal characteristics of wireless channels. Traditional pilot-based methods suffer from noise sensitivity and high computational costs.

  Enhancing OFDM Channel Estimation Accuracy with CNN-LSTM Hybrid Architectures · 2026 · DOI

• While deep learning (DL)–based channel estimation has emerged as an alternative approach, its advancement is hindered by the lack of standardized and reproducible datasets that follow 3GPP-compliant signal models and realistic receiver preprocessing.

  ChanEst Dataset: A Reconfigurable Framework and Benchmark for Deep Learning–Based 6G Channel Estimation · 2026 · DOI

• Open challenges and future directions are discussed, including explainability-performance tradeoffs, explainability-aware data processing, customized XAI for communication-specific structures, cross-layer explanation consistency, and emerging needs for explaining LLM- and Agentic-AI-driven PHY layers.

  Explainable AI for Next-Generation Wireless Physical Layer: Basics, State-of-the-Art, and Open Challenges · 2026

• A fundamental design question in deep joint source-channel coding (Deep JSCC) remains insufficiently explored: given a channel signal-to-noise ratio (SNR), what effective computation depth is required for semantic reconstruction?

  Effective Depth in Joint Source-Channel Coding: An Implicit Equilibrium Analysis · 2026

• While this study focused on Uniform Linear Arrays (ULAs), future research will explore the scalability of the Hybrid GNN-LISTA architecture to two-dimensional planar and conformal arrays, which are increasingly common in 5G/ 6G MIMO systems and advanced radar platforms.

  Hybrid deep unrolling and graph neural networks for super-resolution direction-of-arrival estimation in physics-informed antenna arrays · 2026 · DOI

• Limited accuracy of statistical and semi-deterministic models. Need for effective representation and exploitation of propagation environments.

  Deep learning-based wireless channel prediction with propagation feature exploitation · 2026 · DOI

• The present evaluation is limited to a homogeneous set of devices based on the SX1276 chipset and assumes accurate synchronization and preamble alignment.

  Enhancing Channel Robustness in LoRa Radio Frequency Fingerprinting through a Physics-Informed Residual Spectrogram † · 2026 · DOI

• The optimal way to implement residual connections in Transformer is still debated. Post-LN and Pre-LN have limitations.

  ResiDual: Transformer with Dual Residual Connections · 2026 · DOI

• The existing deep learning-based spectrum completion methods are not adapted to the characteristics of Reference Signal Received Power data. The difficulty in balancing accuracy and efficiency in sparse RSRP scenarios. The need for a spectrum completion method that can handle sparse RSRP data effectively.

  Investigation into the Spectral Completion Algorithm Leveraging Dense Connection Autoencoders · 2026 · DOI

• Existing modulation signal recognition algorithms based on a single feature can't adapt to the different signal characteristics under varying signal-to-noise ratios. The performance of modulation recognition is severely affected by noise in low signal-to-noise ratio environments.

  Transformer-based Modulation Recognition Algorithm with Multi-domain Feature Fusion · 2026 · DOI

• No discussion of generalization performance across different signal bandwidths, carrier frequencies, or channel conditions beyond SNR variations is provided.

  Transformer-based Modulation Recognition Algorithm with Multi-domain Feature Fusion · 2026 · DOI

• The paper suggests exploring the potential of hybrid deep learning models for modulation classification. The paper recommends evaluating the performance of the proposed model on larger datasets. The paper proposes investigating the application of the proposed model to various communication systems.

  Design of a deep learning-based framework for automatic modulation classification in wireless communication systems using neural networks · 2026 · DOI

• This article has presented a comprehensive and systematic analysis of native Artificial Intelligence at the physical layer of 6G networks, providing a unified perspective that integrates theoretical foundations, architectural design, and practical implementation aspects.

  Native Artificial Intelligence at the Physical Layer of 6G Networks: Foundations, Architectures and Implications for the Future Internet · 2026 · DOI

• Attention sinks and outliers in attention residuals are critical bottlenecks that degrade quantization fidelity and destabilize long-range attention allocation. AttnResidual architectures exacerbate attention sinks and activation outliers.

  Attention Sinks and Outliers in Attention Residuals · 2026

• Imperfect CSIT limits the performance of task-oriented semantic communication. Existing link adaptation techniques do not prioritize task success.

  Link adaptation and agentic semantic communication under imperfect CSIT for task-oriented wireless links · 2026 · DOI

• The experimental results are obtained under further compression conditions, - The study focuses on image-oriented models, - The channel conditions and compression ratios are randomly sampled within predefined…

  Research on Multi-Agent Semantic Communication Framework Based on Comparative Learning Joint Optimization · 2026 · DOI

• Wright, Segmentation of multivariate mixed data via lossy data coding and compression, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.

  A Simple But Accurate Approximation for Multivariate Gaussian Rate-Distortion Function and Its Application in Maximal Coding Rate Reduction · 2026 · DOI

• The exploration of other deep learning architectures for signal detection in MIMO-NOMA systems. The investigation of the performance of FDNN-based receivers in more complex scenarios, such as multi-cell networks. The development of more efficient training methods for FDNN models.

  Deep Learning-Based Detection Algorithm for the Multi-User MIMO-NOMA System · 2026 · DOI

• Further evaluation of ResiDual on other tasks. Comparison with other variants of residual connections.

  ResiDual: Transformer with Dual Residual Connections · 2026 · DOI

Most-cited papers in Wireless Signal Modulation Classification

• Deep Learning Enabled Semantic Communication Systems · IEEE Transactions on Signal Processing · 2021 · 1,387 citations
• Semantic Communications: Overview, Open Issues, and Future Research Directions · IEEE Wireless Communications · 2022 · 689 citations
• A comprehensive survey on design and application of autoencoder in deep learning · Applied Soft Computing · 2023 · 573 citations
• A modified Adam algorithm for deep neural network optimization · Neural Computing and Applications · 2023 · 529 citations
• 6G networks: Beyond Shannon towards semantic and goal-oriented communications · Computer Networks · 2021 · 447 citations
• Model-Driven Deep Learning for MIMO Detection · IEEE Transactions on Signal Processing · 2020 · 396 citations
• A Tutorial on Ultrareliable and Low-Latency Communications in 6G: Integrating Domain Knowledge Into Deep Learning · Proceedings of the IEEE · 2021 · 376 citations
• Towards Scalable and Channel-Robust Radio Frequency Fingerprint Identification for LoRa · IEEE Transactions on Information Forensics and Security · 2022 · 372 citations
• Deep Learning-Based End-to-End Wireless Communication Systems With Conditional GANs as Unknown Channels · IEEE Transactions on Wireless Communications · 2020 · 369 citations
• Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach · IEEE Journal on Selected Areas in Communications · 2021 · 341 citations

Most recent work

• A Comprehensive Survey of Large AI Models for Future Communications: Foundations, Applications, and Challenges · IEEE Communications Surveys & Tutorials · 2026
• Reconfigurable Multiscroll Memristive Neural Network With Application to Telemedicine Privacy Protection · IEEE Transactions on Cybernetics · 2026
• Agentic Graph Neural Networks for Wireless Communications and Networking Toward Edge General Intelligence: A Survey · IEEE Communications Surveys & Tutorials · 2026
• Semantic Communications With Computer Vision Sensing for Edge Video Transmission · IEEE Transactions on Mobile Computing · 2026
• A Tutorial on AI-Empowered Integrated Sensing and Communications · IEEE Communications Surveys & Tutorials · 2026
• Superimposed Pilot-Based Adaptive Semantic Communications for Wireless Image Transmission · IEEE Transactions on Wireless Communications · 2026
• Channel Semantic Characterization for Integrated Sensing and Communication Scenarios: From Measurements to Modeling · IEEE Transactions on Wireless Communications · 2026
• Goal-Oriented Semantic Communication for Wireless Video Transmission via Generative AI · IEEE Transactions on Wireless Communications · 2026
• Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communications · IEEE Communications Surveys & Tutorials · 2026
• Multi-Domain Supervised Contrastive Learning for UAV Radio-Frequency Open-Set Recognition · IEEE Journal on Selected Areas in Communications · 2026

Related topics in Computer Science