Urgent.News

What's breaking now, across thousands of outlets.

AI

PrismML brings its tiny LLMs to Qualcomm-powered smart glasses

Prism's larger goal is open-weight AI that runs on devices and makes better use of the computing power they already have.

PrismML, an AI lab founded by researchers from Caltech and advised by UC Berkeley's Ion Stoica, has developed a compact language model suited for smart glasses powered by Qualcomm's Snapdragon chips. This model, called the 1-bit Bonsai LLM, is showcased at Qualcomm's Snapdragon Summit. This is a significant step for PrismML, which has gained recognition for its ability to shrink larger models by a factor of four while maintaining their performance on standard benchmarks.

This startup's primary objective is to promote open-weight AI that can operate locally on devices, reducing reliance on proprietary AI labs and their demand for more computing power. The 2-billion-parameter model is tailored for vision and language tasks, enabling real-time object recognition in smart glasses. However, no smart glasses equipped with PrismML have been announced as of now.

Written by urgent.news from TechCrunch's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at techcrunch.com →

More in AI

Earth fact of the day

An average of 72 percent of respondents said they felt curious, happy or excited about A.I., compared with 41 percent who felt worried, sad or angry.’@nytimes‘s Damien Cave uses @Gallup data to remind…

More from Thursday 24 September →