Current Issue

Romanian Journal of Information Technology and Automatic Control / Vol. 36, No. 1, 2026


From command to symbiosis: Integration paradigms and conceptual frameworks for seamless multimodal Human-Robot Interaction

Jiangke WU

Abstract:

Human-Robot Interaction (HRI) is currently undergoing a paradigm shift from discrete command-based control to seamless, symbiotic communication. However, achieving this symbiosis requires overcoming significant challenges in temporal alignment and computational efficiency, particularly when processing conflicting multimodal signals. This paper presents a hybrid study combining a semi-systematic literature review (2020–2025) with a novel conceptual framework. The study critically evaluates the architectural evolution from standard Transformers to linear-complexity State Space Models (SSMs), such as Mamba, highlighting the trade-offs between long-term semantic context and real-time responsiveness. Furthermore, the Multimodal Perception-Driven Decision-Making (MPDDM) framework is introduced as a conceptual model designed to resolve conflicts between explicit commands and implicit physiological cues via a dynamic confidence-weighting mechanism. To address the limitations of traditional latency-based benchmarks, a new set of evaluation metrics, specifically Modality-Specific Fluidity (MSF), is proposed to quantify the smoothness of interaction. Finally, recent integration paradigms are categorized into modular and end-to-end Vision-Language-Action (VLA) models, offering a critical synthesis of their respective safety and efficiency profiles. This work provides a roadmap for developing verifiable, low-latency HRI systems capable of operating in dynamic, unstructured environments.

Keywords:
Human-Robot Interaction, Seamless symbiosis, Multimodal fusion, State space models, Interaction repair.

View full article:

CITE THIS PAPER AS:
Jiangke WU, "From command to symbiosis: Integration paradigms and conceptual frameworks for seamless multimodal Human-Robot Interaction", Romanian Journal of Information Technology and Automatic Control, ISSN 1220-1758, vol. 36(1), pp. 91-105, 2026. https://doi.org/10.33436/v36i1y202607