Cognitive Impact Of Multiple Gestures In Simultaneous Tasks

Abstract

This study examines the cognitive impact of mid-air hand gestures (hover, pinch, and swipe) in multitasking environments, evaluating their efficiency, mental load, and effects across age groups. A laboratory-based experimental design was conducted with 120 participants (aged 18–65), who engaged in tasks of varying complexity (low/high) and received one of three feedback modalities (visual, auditory, haptic). Objective (reaction time, error rate, EEG activity) and subjective (NASA-TLX) metrics were collected. Findings indicate that the hover gesture achieved the best balance between speed and cognitive load (1,200 ms; NASA-TLX: 45/100), making it suitable for high-demand contexts such as robotic surgery or air traffic control. Conversely, the swipe gesture increased mental load by 65% in complex tasks. Haptic feedback emerged as the most effective, reducing cognitive load by 34% (EEG theta: 4.3 µV vs. 6.5 µV visual) and improving accuracy to 92%. Significant age-related differences were also observed: older adults exhibited 40% slower response times; however, haptic feedback partially mitigated this performance gap. These results highlight the need for inclusive, adaptive interfaces grounded in cognitive ergonomics. The study concludes that hover gestures combined with haptic feedback provide an optimal configuration for cognitively demanding environments. This research offers a rigorous methodological framework and practical design recommendations for implementing gesture-based interaction in medical, industrial, and extended reality applications.