Live Captions XR

Transform conversations with LiveCaptionsXR - the world's first spatially-aware AR captioning app powered entirely by on-device AI. 🎯 Built for the 466 million people with hearing loss worldwide LiveCaptionsXR goes beyond traditional captioning by anchoring speech in 3D space. Instead of flat text, experience conversations with captions that appear exactly where the speaker is located - like having AI-enhanced spatial hearing. ✨ Revolutionary Features: Spatial AR Captions - Captions float in 3D space at the speaker's exact location using ARCore On-Device Privacy - All processing happens on your device. No data ever leaves your phone Real-Time Hybrid Localization - Advanced AI fuses stereo audio, camera vision, and motion sensors to track speakers with pinpoint accuracy Powered by Google's Gemma 3n - State-of-the-art on-device AI for intelligent, context-aware transcription Offline-First Design - Works without internet using Whisper GGML for private speech recognition 🔬 Cutting-Edge Technology: Built by a deaf developer who understands the challenges firsthand, LiveCaptionsXR combines: Stereo Audio Direction Estimation using RMS and GCC-PHAT algorithms Visual Speaker Detection with ML Kit face recognition Kalman Filter Fusion for rock-solid 3D speaker tracking Cross-Platform Flutter Architecture for seamless iOS/Android experience 🎮 Perfect For: XR/AR headset users needing spatial awareness Conference participants wanting to know who's speaking Students and professionals in group settings Anyone seeking private, on-device accessibility solutions ��️ Privacy-First: Your conversations stay private. All AI processing happens locally on your device using advanced on-device models. No cloud processing, no data collection, no privacy concerns. 🚀 Experience the Future of Accessibility: Download LiveCaptionsXR today and discover a new way of experiencing conversations - where captions don't just tell you what was said, but show you exactly where and who said it. Built with ❤️ for the deaf and hard of hearing community