Forge
HomeWebsitesMaintenanceShowcasesToolsBlogShow me what’s missing in 7 points
Technical

Robots.txt Checker

Fetches /robots.txt directly and checks that it exists, loads, follows recognizable syntax, and declares a sitemap — never crawls anything it references.

Make sure search engines can read your crawling rules the way you intend.

We'll check your site's homepage — this usually takes a few seconds.

How this works

This fetches your /robots.txt directly and checks its syntax and sitemap declaration. We fetch your homepage directly — never Google Search or Google Maps — analyze the HTML and response ourselves, and never invent a fact we can't actually check. Where something is estimated rather than directly confirmed, it's labeled that way.

  • The website you provide

    Computed entirely from what you told us — nothing looked up externally.

Questions about this tool

Just your homepage, on purpose — that keeps results fast and every finding traceable to something we actually fetched, rather than an unbounded crawl of your whole site.

Related tools

Technical

Sitemap Checker

Check whether your sitemap.xml exists, loads, and lists your pages.

Technical

Website Health Check

The complete picture — every check this engine runs, on one page.

Technical

Link Checker

Count your internal/external links, catch empty or malformed ones, and test a sample of internal links for real.