Show HN: Made an open-source Lego AI generator

A software developer has created an open-source AI tool that generates LEGO models through the use of artificial intelligence. By providing the AI agent with an idea for a model, the agent can guide its own building process and generate a LEGO model using the LDraw format. The tool employs semantic search and re-ranking technology powered by TypeSafe's Jev System One AI model.

To run the web app, users need Docker and Git installed on their computers. The app requires two sibling repositories to be cloned and built together, as they work in tandem. The initial build can take some time and requires approximately 5 GB of disk space.

The tool is designed to work on any network other than localhost, for example, by using the computer's IP address instead. Although the app does not require a login, it should only be run on trusted networks. The development of this tool was motivated by a desire to create AI agents capable of designing buildable physical objects, particularly LEGO models.

The developers experimented with various AI models, such as ChatGPT and Claude, in order to make them code in the LDraw assembly language. Despite initial challenges, the agents performed surprisingly well on geometric math tasks commonly found in LDraw, making the project a success. The developers concluded that there is a minimum threshold for geometry math required for AI agents to perform effectively.

To assist the AI agent in designing models, the tool provides Python-based tooling with the necessary primitives, verbs, and constructive vocabulary. This allows the agent to learn by example and create models independently. The developers have included guides and references within the tool to help the AI agent build models using real LDraw parts.

The first release of the tool still has some areas that need improvement, but it provides users with the tools, examples, and instructions needed to design LEGO models. The developers acknowledge the contributions of many other LDraw creators and encourage anyone who feels they should be recognized to reach out to them. LEGO is a trademark of the LEGO Group, which does not endorse or sponsor this software.