How Unilever tailors AI focus to business outcomes

AI Crawlers in robots.txt: Should You Block or Allow Them?

Disclosure I'm a developer who works with React, Next.js and AI agents, and I offer related SEO and AI services, so I have a business interest in this topic.

• AI crawlers fetch web pages for training LLMs and AI search tools.
• Block AI training crawlers like GPTBot and ClaudeBot only with clear reason.
• Allow AI search crawlers like OAI-SearchBot and Claude-SearchBot for visibility.

1h ago ·dev.to

Math 2.0: Turning Terence Tao’s Vision into Practical AI‑Ready Tools

1. What was released / announced On June 1 2026, Terence Tao, together with a team of Caltech researchers, published a 120‑page PDF titled “Math 2.0” .

• Terence Tao and Caltech unveil Math 2.0 on June 1, 2026
• Python library math2py, Jupyter notebooks, and REST API enable querying mathematical objects
• Math 2.0 integrates formal math, symbolic computation, and LLMs for AI-ready tools

1h ago ·dev.to

I turned Karpathy's LLM Wiki into a native GNOME app (and it works offline)

In April, Andrej Karpathy posted a short "idea file" called LLM Wiki . The pitch: stop making your model re-read raw documents on every question.

• Andrej Karpathy introduced LLM Wiki in April
• gknowledge transforms documents into AI-assisted knowledge bases
• gknowledge is offline by default and uses Markdown files

1h ago ·dev.to

The IMF lifts its 2026 global GDP growth forecast to 3.1%, up from 3% in July, citing an AI boom that offsets Middle East war disruptions and high energy costs (Anniek Bao/CNBC)

BANGKOK — The International Monetary Fund has raised its forecast for global growth this year as the AI-driven investment boom helps offset …

1h ago ·cnbc.com