Urgent.News

What's breaking now, across thousands of outlets.

Tech

Idlewild: Turn Your Breath into Animation and Sound

This is a submission for the Presage SmartSpectra SDK Challenge What I Built Idlewild is a desktop performance studio for animators and game makers. You breathe, move and perform in front of a webcam; SmartSpectra measures your chest breathing and, when your chest and face are well framed, breathing rate and pulse rate; on-device tracking follows your face and body, and a character performs with…

Idlewild is a desktop performance studio designed for animators and game developers. Users interact with it by breathing, moving, and performing in front of a webcam. SmartSpectra, an SDK, measures the user's chest breathing, breathing rate, and pulse rate. When the user's face and body are well-framed, SmartSpectra tracks them on the device.

A character then performs with the user. Users can record a performance once and replay it on any character or scene. The studio exports video, procedural sound, a baked GLB with real breathing and pulse curves, and CSV curves for animation tools. Idlewild aims to provide breathing captured from a real person rather than a sine wave.

The project is built on the Presage SmartSpectra SDK, using Electron, TypeScript, and Three.js. Users breathe, move, and perform in front of a camera; SmartSpectra measures their chest breathing, breathing rate, and pulse rate. On-device tracking follows the user's face and body. The character breathes with the user, and the performance can be recorded and replayed on any character or scene.

The export includes video, procedural sound, a baked GLB with real breathing and pulse curves, and CSV curves for animation tools. SmartSpectra frames and local MediaPipe tracking from the same camera are merged onto one timeline. The project emphasizes creative animation, not medical measurement.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in Tech

More from Thursday 19 November →