Building FoxyInvoice — Chapter 11: Reach — SEO, AI crawlers, and being the machine-readable answer
This series is written in the open, from a real production system. This chapter is the reach stack: prerendering, robots.txt, llms.txt, IndexNow, and measuring it all with access logs. [All chapters and diagrams live in the public repo.] Somewhere between "launched" and "learned people exist," every product discovers distribution. Ours arrived with a twist that defines this chapter: half your…
This chapter details the process of ensuring that a client-side Angular Single Page Application (SPA) is crawlable by search engines and AI crawlers, such as Googlebot, AI crawlers like GPTBot, ClaudeBot, and PerplexityBot. The key points include the implementation of a robots.txt file that allows only specified routes to be indexed, prerendering static pages at build time, publishing an llms.txt file for AI crawlers, using IndexNow for faster indexing, and measuring crawl activity using access logs.
The goal is to ensure that the product is accessible and readable to both human and machine users, thus improving the site's visibility and accessibility in search results.
Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
