Urgent.News

What's breaking now, across thousands of outlets.

AI

Calibration Is Bet Sizing

The last post was about making a number trustworthy. Leakage geometry, purge widths, de-overlap, a baseline that could not cheat. It ended with a minute-scale ceiling that held at 52% across seven configurations and a model family swap. This one is about what happens after you trust the number. Because a probability you are going to bet on is a different object from a probability you are going to…

The final section of the audit covers the reason behind selective rollout of the calibration system. Six of the seven assets improved calibration, while one asset, LINK-USD, did not see any improvement and even underperformed in terms of calibration error and log-loss. The audit concludes that the calibration system should be selectively rolled out, with LINK remaining on raw softmax until further investigation.

The mechanism for implementing this selective rollout is described as boring and straightforward, involving setting up an allow-list of assets to use the calibrated model and excluding LINK if necessary.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

AI Agent Standards Experiment: Test Rules Before Teams Trust Them

AI agents can look reliable after one impressive demo and still fail the moment real users, messy repositories, and conflicting instructions enter the room.

  • AI agents may appear reliable but can fail in real-world scenarios.
  • Teams often change agent rules based on gut feelings, not evidence.
  • The guide provides a lightweight experiment system for AI agent standards.

Generate endless Roblox quests with AI (and cache them so it's cheap)

Hand-written quests run out. Players finish your content faster than you can write it, and the tenth "collect 10 wolf pelts" quest feels like filler.

  • AI generates dynamic quests for Roblox players
  • Cortex library integrates AI into Roblox game
  • Cached content eliminates repetition and reduces costs

AI chat moderation in Roblox — by meaning, not a word list

Word-list chat filters break the moment someone types a s s a s s i n with spaces, or a slur spelled with a 0 , or a perfectly innocent word that happens to contain a banned substring.

  • Roblox replaces word-list filters with AI chat moderation system
  • AI model analyzes message meaning, catches obfuscated toxicity
  • Developers use Cortex component, specify game context for moderation

I Got 28 TPS Out of Free Kaggle GPUs. Here's What It Took.

I want to be upfront about something: this whole project runs on free Kaggle T4 notebooks, an AWS EC2 t3.micro relay that costs almost nothing, and public internet. No A100s.

  • Researchers split 7B model across two Kaggle T4 GPUs for free GPU training
  • Speculative decoding improved token generation speed from 4.92 TPS to 14.3 TPS
  • CUDA Graphs optimization reduced draft generation time from 112ms to 25ms

More from Sunday 23 August →