URL Inspector

Unsupported input

The tool may reject input that does not match the expected content, structure, or file type.

Fix: Confirm the tool input requirements and paste the correct type of data.

Incomplete values

Missing fields or partial content can block processing or produce weak results.

Fix: Provide the full required input before running the tool.

Copying placeholder content

Sample or placeholder values can lead to output that looks valid but is not ready for real use.

Fix: Replace placeholders with your actual values before relying on the result.

How many URLs can URL Inspector check per request?

URL Inspector checks up to 100 URLs per batch so the request completes in under a minute and doesn't hammer third-party servers. For larger sweeps, run the tool in a loop from a script.

Does URL Inspector handle JavaScript-rendered pages?

URL Inspector fetches the raw HTML served to a crawler, which is what search engines index for the first pass. If your site relies on client-side rendering, the tool shows you exactly what Googlebot's initial render sees before it runs JavaScript.

What User-Agent does URL Inspector send?

URL Inspector sends a User-Agent string that identifies itself honestly (DevFox bot) rather than impersonating Googlebot — spoofing UAs can get a site's access flagged. If a page blocks non-browser UAs, you'll see the block clearly reflected in the output.

Can URL Inspector check password-protected pages?

No. URL Inspector only makes anonymous public requests — it can't log in or carry session cookies. For auth-protected pages, use a headless browser in your own environment.

Does URL Inspector respect my robots.txt?

Yes. URL Inspector fetches and parses robots.txt before crawling a site and skips disallowed URLs by default. You can toggle off the check if you're auditing your own site and want to see every status code.