Urgent.News

What's breaking now, across thousands of outlets.

Continued

AI

acc vs acc_norm: Why Length Bias Skews LLM Eval Scores

Your fine-tune gains three points of acc_norm on HellaSwag and loses two points of acc . Same checkpoint, same harness, same seed.

  • "acc" measures highest summed log-likelihood of candidate continuation
  • "accnorm" divides sum by byte length of continuation string
  • Length bias can skew LLM evaluation scores significantly

AI

Welcome to the AI crisis in math

Today on Decoder, I’m talking with Robert Hart, The Verge’s London-based AI reporter, about what AI is doing to the field of mathematics and the existential crisis many lead mathematicians are having about it. OpenAI just published a set of solutions to longstanding problems in math that went off like a bombshell in the field. […]

AI

For a16z, AI gives foreign founders an advantage

a16z’s Borderless Founder network initiative supports immigrant and international founders. 'Having one foot in your home country, and one foot in Silicon Valley," is an advantage, the firm believes.

  • 44% of investments in a16z's Apps Fund One and Two come from international founders.
  • AI agents enable startups to secure contracts with Fortune 500 companies worldwide.
Continue reading →