I Replaced $3,000 Eye-Trackers with a Laptop Webcam: Building a Hands-Free Spatial Communicator with SmartSpectra
This is a submission for the Presage SmartSpectra SDK Challenge What I Built Traditional Augmentative and Alternative Communication (AAC) systems for people with severe motor and speech impairments (such as ALS, high-level quadriplegia, or locked-in syndrome) force an impossible trade-off: spend $3,000+ on specialized infrared eye-tracking hardware , or endure exhausting dwell-time interfaces…
This report details a project designed to provide an accessible communication solution for individuals with severe motor impairments. Traditional eye-tracking systems for augmentative and alternative communication (AAC) are extremely costly, often exceeding $3,000. The report details a new system called NeuroScribe Studio, which builds upon the Presage SmartSpectra SDK, transforming a standard laptop webcam into a hands-free communication device.
The system's core features include 3D spatial gaze and head-pose targeting, temporal blink discrimination, attentive standby lockout, an interactive 5-second calibration process, cross-device caregiver mirror synchronization, and human-in-the-loop speech synthesis. These features enable users to navigate communication options using eye gaze and deliberate blinks, while hands remain off the keyboard.
The system also includes a caregiver mirror that synchronizes messages with a second device, providing audio and haptic feedback.
The implementation relies on real-time data from the webcam, processed through a WebSocket connection to a local SmartSpectra Node SDK daemon. The system filters out jitter from the webcam and normalizes iris coordinates and head pose for precise spatial targeting. Blink detection differentiates between natural blinks and deliberate selection actions, while speech articulation detection ensures the user has control over spoken messages.
The system also monitors respiratory patterns and facial expressions to create a responsive, ambient communication environment.
The project emphasizes user comfort and control, preventing accidental selections and minimizing visual fatigue. The communication interface is customizable, featuring a variety of communication boards and options for picture symbols, text-based messaging, and speech output. The entire system is designed for use in a hospital or home setting, with privacy and consent safeguards in place to protect user data.
Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
