Navigating Emotions: A Multimodal Approach to Redefining Nautical Naval Design

This study outlines an innovative approach to nautical naval design, merging artificial intelligence with the nuanced analysis of human emotions to elevate the sea travel experience. A collaboration between the University of Genoa's Ph.D. program in Marine Science and Technology and the Merchant Marine Academy of Genoa has resulted in the development of an advanced multimodal system. This system employs the Facial Action Coding System (FACS) and the Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for real-time analysis and response to human emotions aboard naval vessels. The aim is to personalize maritime spaces, ensuring safety and well-being for passengers by capturing and responding to the emotional nuances of clients. The research incorporates various sensory modalities, including facial expression and vocal prosody to achieve a comprehensive understanding of emotions. Initial findings demonstrate the system's potential in creating emotionally resonant environments, with applications in romantic, adventure, wellness cruises, and more. The methodology combines video and audio analysis, self-assessments, and expert evaluations to ensure data coherence. Future work will explore the integration of Virtual Reality (VR), Augmented Reality (AR), non-invasive biometric sensors, and electroencephalography (EEG) to deepen emotional understanding and further personalize the sea travel experience. This innovative convergence of technology and empathy in naval design promises to revolutionize the concept of sea travel, making it a more intimate and responsive journey.