I'm an architect. I built an AI agent that draws - and outputs IFC models

The architect behind Axio Coder, an open-source AI agent, explains how they developed a tool that can draw and output IFC models within their project. The challenge, which is often overlooked, lies in operating native programs without an API. This includes CAD windows, Photoshop, and MS Paint, which do not expose any endpoints. To overcome this, Axio Coder uses the UI Automation tree, where every native control announces its name, type, and value to the operating system, allowing the agent to ask for specific controls like the "Fill with color" button and receive real answers from the app itself.

With this capability, the agent can draw a rocket in Paint, stroke by stroke. The agent's ability to see and compare its output against a reference, whether it's a photo, a drawing, or a spec with dimensions, allows it to generate engineering models and write them out in industry-standard formats like IFC, DXF, and STEP. The generated folder in the repository contains multiple revisions of the same piece, each reviewed and corrected.

The agent's memory, notes, and past sessions are indexed and retrieved semantically, eliminating the need to start from zero every morning. It also provides clear differences between edits, offering a detailed log or session history for reference. The terminal features a live shell with a card per process, enabling real-time monitoring of the agent's operations.

While Axio Coder is a single-user desktop app and not a replacement for CAD software, its primary purpose is to handle the tedious 80% of repetitive tasks so architects and engineers can focus on the 20% that requires human judgment. The developer invites feedback from professionals in the field to identify any limitations or areas for improvement.