HomePeopleCompaniesAI ModelsOpen SourceAgentsResearchApps
AllModelsInferenceToolingImage and Video
Open SourceTooling 6 May 2026 r/sideprojects

Free scanner checks whether a site is invisible to AI crawlers

The brief

A free tool scores any URL on 8 AI-relevance signals and generates a ready /llms.txt file.

Key points

  1. The four pillars: clean HTML, JSON-LD structured data, a robots.txt that permits AI bots, and llms.txt.
Read the original

Sources