I asked Lovable, Bolt, and Google AI Studio to build the same web app, and one is in a different league
All three got the math right, but only one understood the meaning behind the numbers
Three no-code AI services, Google AI Studio, Lovable, and Bolt, were asked to create the same web app for analyzing game benchmark runs. Each service received the same prompt describing the desired output, including average FPS, 1% low FPS, frames exceeding 50ms, frame rate cap recommendation, and a graph showing the frame rates.
Bolt's app was the most straightforward to use, providing accurate arithmetic results with minor issues in its interpretation. However, Bolt's graph analysis method flattened the performance data, leading to an inaccurate choppy verdict for smooth runs.
Google AI Studio delivered the fastest results, offering an intuitive UI and useful zoomable graphs. However, its recommendation to set the frame rate cap to 0 or 1 FPS was impractical, indicating a potential flaw in its reasoning process.
Lovable stood out by providing clear, context-aware insights into frame rate issues, attributing performance hitches to loading or shader compilation and recommending specific solutions like in-game or external frame rate limiters. This approach proved more useful for users comparing multiple runs, saving them time and effort in analyzing the results.
Written by urgent.news from XDA Developers's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.