01
Copy your robots.txt
Open yoursite.com/robots.txt and copy everything.
Free SEO tool
Free Robots.txt Checker
Test whether a URL is allowed or blocked for Googlebot and other crawlers based on your robots.txt rules.
Free and private: this tool runs entirely in your browser. Want experts to review everything? Get a professional SEO audit
How to use it
How to use the Robots.txt Checker
Three steps, under a minute.
02
Enter a path and crawler
Test any URL path for Googlebot, Bingbot, GPTBot or all crawlers.
03
Read the matched rule
The tool shows which rule allows or blocks the path and why.
More free tools
More free SEO tools
SEO Audit Tool
Run a quick on-page SEO audit of any page by pasting its HTML. Checks titles, meta tags, headings, images, links, canonical and structured data.
Open toolKeyword Rank Checker
Find where a domain appears in a results list. Paste the result URLs for a keyword and we show the position of your domain and competitors.
Open toolKeyword Research Tool
Generate hundreds of keyword ideas from a seed term, grouped by intent: questions, commercial, local and comparisons.
Open toolBacklink Checker
Analyze a backlink export from any tool. Paste URLs to see referring domains, anchor text mix and link patterns.
Open toolWebsite SEO Checker
Check the SEO basics of any page in seconds by pasting the page source code.
Open toolSERP Checker
Preview how your title and description appear in Google search results on desktop and mobile, with pixel width checks.
Open toolFAQ
Robots.txt Checker FAQ
How the tool works and what to do with the results.
2 daysto your free audit
<24hreply time
2questions answered
RE
RankEmpireUsually replies within a day
01 / 2
We rank
with
Robots.Let's Talk
Talk with us →We're a small team of strategists, technical specialists and AI nerds, blending SEO, answer engines and automation so your pages turn into calls, not just rankings.