User-agent: * Allow: / # Sitemap Sitemap: https://spatio.app/sitemap.xml # NOTE: no Crawl-delay directive, deliberately. # There used to be `Crawl-delay: 10` here. Google ignores it, but Bing and most # AI/LLM crawlers honour it — at 10s per URL a full crawl of this site took # minutes, and any crawler on a time budget gave up partway through. There is no # capacity reason for it either: the site is statically generated and served # from Vercel's CDN, so crawl traffic costs us nothing. Do not reintroduce it.