Urgent.News

What's breaking now, across thousands of outlets.

AI

Making LLM ratings auditable: quotes, limitations, and "can't judge" instead of zero

From Auditable LLMs to Auditable Vision Rehab: Why Transparency Wins A recent dev.to post sparked a necessary conversation about LLM-generated ratings. The author proposed a radical ruleset: fix the evidence window, show the actual quotes, admit limitations, and provide a "can't judge" button instead of inventing a score. The core objective is to stop confident-sounding noise from masquerading as…

In a recent dev.to post, an author proposed a set of guidelines for LLM-generated ratings. The main points are to fix the evidence window, display the actual quotes, acknowledge limitations, and offer a "can't judge" button instead of generating a score. The goal is to stop highly confident-sounding information from being presented as factual evidence.

This concept of auditability is particularly relevant in the field of vision rehabilitation for amblyopia, where the industry has often operated as a "black box." Patients, especially adults, were exposed to opaque treatments like patches, red-blue glasses, and rigid clinic schedules. There was no dashboard, no control over content, and no visibility into what the dominant eye was seeing compared to the lazy eye.

This is where the Amblyotube app, developed by Seven Sports for Meta Quest, comes in. By leveraging the headset's independent eyepieces, Amblyotube implements dichoptic vision training, turning the experience into a transparent layer over the user's preferred content. Instead of traditional therapy methods that often bore teenagers and cause them to abandon treatment, Amblyotube uses the user's own videos as stimuli, allowing them to take control of their rehabilitation.

The app provides several key technical features to enhance transparency: the Dominant Eye Shader allows users to adjust blur, contrast, brightness, and opacity; the AI-Driven MFBF (Lazy Eye Sharpener) uses AI to identify human figures in the video and apply sharpening to the lazy eye's feed; and the Magenta Focus Cue, a high-visibility magenta circular signal, helps train the brain to fuse the two images.

On-device inference keeps user data private and allows for offline use. The app's design choices prioritize transparency and user control, turning a traditionally opaque therapy into an auditable, user-driven process that can improve visual coordination and attention in a more sustainable and engaging manner.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

🌿 Terra-Gotchi: The 100% Offline AI Companion That Feeds on Real-World Nature

This is a submission for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass What I Built Wellness apps usually trap you in a new cycle of screen time.

  • Terra-Gotchi is an offline AI digital pet for engaging with the physical world
  • Users feed Terra-Gotchi real-world natural textures via photos
  • Project emphasizes open innovation and user privacy through offline operation

BirdLens AI: Identify Birds Locally, Explore Nature Offline

BirdLens AI — An Open-Source AI Bird Identification Companion This is a submission for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass .

  • BirdLens AI is an open-source bird identification tool for beginners.
  • Users can identify birds offline using an open-weight model.
  • The app promotes responsible birdwatching practices.

More from Sunday 11 October →