{
  "id": 13591315,
  "title": "I expected Jev to remember 2025. It doesn't know Trump was inaugurated",
  "url": "https://urgent.news/2026/10/11/i-expected-jev-to-remember-2025-it-doesnt-know-trump-was-inaugurated",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-11T00:23:04.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/moonthetrain/i-expected-jev-to-remember-2025-it-doesnt-know-trump-was-inaugurated-4ifd"
  },
  "original_language": "en",
  "account": "The author expected a language model named Jev to be able to recall significant events from 2025, such as Donald Trump's inauguration. However, Jev only correctly answered one out of 17,036 markets related to the year 2025, while achieving a 0.30 probability for all other markets. The author conducted tests on different months leading up to and after the release of Jev, spanning from January 2025 to September 2026. The results showed that Jev's performance was similar across all months, with a 0.68 accuracy rate, which is equivalent to random guessing. The author concluded that Jev does not possess the ability to remember events from 2025, contradicting the initial assumption.",
  "summary": "I expected Jev to have learned the outcomes of old prediction markets. It hasn't. Asked \"Will Donald Trump be inaugurated?\" about the January 2025 market, Jev says 0.70. Asked whether the Fed raised rates in January 2025, it says 0.30, the same number it gives almost everything. Across 17,036 Polymarket markets resolved up to 20 months before its release, Jev's ability to rank Yes from No (AUC…",
  "key_points": [
    "Jev language model incorrectly answered 99.7% of 2025-related markets",
    "Jev achieved 0.30 probability for all markets except one",
    "Jev's performance was equivalent to random guessing at 0.68 accuracy"
  ],
  "editors_take": "This development suggests that Jev's capabilities are not as advanced as initially thought, indicating a significant limitation in its ability to recall future events.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}