Free Website SEO Audit (Crawler)
Crawl your whole site and find SEO issues.
What is the Website SEO Audit (Crawler)?
Auditing one page tells you about that page. Auditing a whole site tells you about problems that only show up at scale — the duplicate titles across a dozen product pages, the broken internal links no one clicks, the section of thin pages dragging everything down.
This website SEO audit crawls your site from a starting URL, follows internal links, and reports the issues across every page it visits, with a site score and a worst-pages-first breakdown.
Last updated: Aug 12, 2026
What does this tool do?
It starts at the URL you give it, fetches the page, finds the internal links, and keeps crawling — up to the page limit you choose — the way a search engine's crawler does, while respecting your robots.txt.
For every page it records the on-page basics, then aggregates site-wide problems: broken internal links, duplicate titles and descriptions, missing titles, descriptions and H1s, thin content, noindex pages, missing canonicals and images without alt text.
Key features
Whole-site crawl
Follows internal links up to your chosen page limit (up to 40).
Broken-link detection
Checks internal links and flags 4xx/5xx and dead URLs.
Duplicate detection
Finds pages sharing the same title or meta description.
Per-page breakdown
Lists pages worst-score-first with their issue counts.
Respects robots.txt
Skips disallowed paths and uses an identified crawler.
Example
Common use cases
- Site owners — Get a health check across the whole site, not one page.
- SEO specialists — Find site-wide issues to prioritize.
- Web developers — Catch broken links and missing tags before launch.
- Agencies — Run a quick site audit for a client.
- Content teams — Spot duplicate titles and thin pages.
- Ecommerce managers — Check product pages for duplicate metadata.
- Migrators — Verify a site after a redesign or move.
- Bloggers — Audit an archive of posts at once.
Benefits
- It surfaces problems that only appear across many pages.
- Broken-link and duplicate detection are built in.
- The worst-pages list tells you where to start.
- It crawls politely, respecting robots.txt.
Tips
- Start with a 10–20 page crawl to get results fast, then go deeper.
- Fix critical issues (broken links, missing titles, noindex) before warnings.
- Duplicate titles often come from templated pages — make them unique.
- Thin-content pages may be worth expanding or consolidating.
- Re-crawl after fixes to confirm they worked.
- If nothing crawls, your robots.txt or a bot block may be stopping it.
- Large sites: raise the page limit or crawl section by section.
- Pair it with the single-page audit for a deep look at key pages.
Common mistakes to avoid
Ignoring broken internal links
Fix: They waste crawl budget and frustrate users — fix or redirect them.
Duplicate titles across templated pages
Fix: Give each page a unique, descriptive title.
Leaving pages noindex by accident
Fix: Check flagged noindex pages are meant to be excluded.
Crawling once and forgetting
Fix: Re-audit after changes and periodically as the site grows.
How it works
- 1
Enter your site URL
Start from your homepage or any section.
- 2
Crawl
It follows internal links up to your page limit.
- 3
Review issues
Work through the site-wide issues and worst pages.
Frequently asked questions
Up to 40 pages per run (you choose the limit). It crawls same-site HTML pages, respecting your robots.txt.
Broken internal links, duplicate titles and meta descriptions, missing titles/descriptions/H1s, multiple H1s, thin content, noindex pages, missing canonicals and images without alt text.
Yes. It skips paths your robots.txt disallows and uses a clearly identified crawler user-agent.
No. Pages are fetched only to analyze them during the crawl and nothing is saved.
Up to 40 pages per run — you choose the limit. It crawls same-site HTML pages, respecting your robots.txt.
Broken internal links, duplicate titles and meta descriptions, missing titles/descriptions/H1s, multiple H1s, thin content, noindex pages, missing canonicals and images without alt text.
Yes. It skips paths your robots.txt disallows and uses a clearly identified crawler user-agent.
It follows internal links from the start URL. If pages aren't linked, or robots.txt blocks them, or the site blocks bots, they won't be crawled.
No. Pages are fetched only to analyze them during the crawl, and nothing is saved.
The single-page audit does a deep check of one URL; this crawls many pages to find site-wide patterns like duplicates and broken links.
Conclusion
A whole-site crawl turns SEO from page-by-page guesswork into a prioritized to-do list. Use it to find site-wide issues, then the single-page audit and SERP preview to perfect your most important pages.