Sensors (Basel, Switzerland)GesturesHumansSmartphoneHandArtificial Intelligence
Sign2Story: A Multimodal Framework for Near-Real-Time Hand Gestures via Smartphone Sensors to AI-Generated Audio-Comics.
Gul Faraz, Lei Jing, Xiang Li
Published: 202610.3390/s26020596
Abstract
This study presents a multimodal framework that uses smartphone motion sensors and generative AI to create audio comics from live news headlines. The system operates without direct touch or voice input, instead responding to simple hand-wave gestures…
Preview only. Read the full abstract at the source