Urgent.News

What's breaking now, across hundreds of outlets.

AI

Dev squeezes an AI language model onto a floppy for 486DX and Pentium PC stalwarts

An inspired developer has shoehorned a language model onto a floppy disk created especially for 486DX and Pentium PC users running DOS.

Dev squeezes an AI language model onto a floppy for 486DX and Pentium PC stalwarts

A developer named WollyMonjac has managed to fit an AI language model onto a floppy disk designed for 486DX and Pentium PCs running DOS. The project, called Tiny 2.1, is not a large language model (LLM) but rather a "tiny question-answering transformer written in Turbo C 2.0." Despite the limited space on a 486-era floppy disk, which typically holds around 1,475,000 bytes of data, Tiny 2.1 manages to include 367,000 parameters, including 4 layers, 96 wide, and 8-bit weights, totalling 380 KB.

The model was trained on approximately 3,500 facts, each posed in multiple ways. To run Tiny 2.1, an old PC would need approximately 540KB of free conventional memory. The interface is clean, featuring a conversation history pane, a neural monitor panel, and an "Ask Tiny" prompt window. It also includes an Ask Tiny prompt window and even a PC-speaker robot voice for the responses.

The developer, while modest, admits that there may be inaccuracies as the model "makes things up confidently." The GitHub repository indicates that Tiny 2.1 was "Written by Fable 5.2 and trained by Opus 5.5." Despite its limitations, users can train the model further if desired. The story of Tiny 2.1 underscores a trend of getting modern software to run on older hardware and vice versa, with examples including a ChatGPT client for DOS, Minecraft on a Game Boy, image generation on a C64 with AI, and Doom on an Atari ST.

Rewritten by urgent.news; may contain errors — check the original.

Source: tomshardware.com

Read the original at tomshardware.com →

Report a problem with this story

More in AI

More from Sunday 22 November →