All guides

Website Audit: Crawl Your Whole Site

Site Audits 1 min readJune 23, 2026

Website Audit: Crawl Your Whole Site

A single-page report is great for one URL. Website Audit (Site Crawl) audits every page on a domain.

When to use a site crawl

  • Launching a new website or migration
  • Monthly technical SEO health checks
  • Client onboarding — baseline before recommendations
  • Finding duplicate titles, broken links, and orphan pages at scale

Start a crawl

1. Go to Analysis → Website Audit.

2. Enter your root URL (e.g. https://example.com).

3. Configure limits if needed (max pages, crawl depth).

4. Start the crawl job.

Large sites may take longer than a single-page report. Progress appears on the crawl job page.

Navigate your results

Overview

See site-wide health score, issue counts by severity, and trends vs previous crawls.

Crawled Pages

Browse every discovered URL. Filter by:

  • Issue type (missing meta, thin content, redirect chains)
  • Page kind (homepage, product, blog, etc.)
  • Traffic data (when Search Console is connected)

Site Structure

Visualise how pages link together — useful for finding orphan pages and deep architecture problems.

Compare crawls

Run a new crawl after fixes and compare to the previous audit to confirm issues were resolved.

Optional: JavaScript rendering

For SPAs or heavy JavaScript sites, enable JS rendering so the crawler sees content loaded by the browser.

Connect Search Console

Link Google Search Console to enrich crawled pages with clicks, impressions, and index status. See the Search Console guide.

Best practices

  • Crawl staging before production launches when possible.
  • Ignore known false positives (e.g. intentional noindex pages) from the issue toolbar.
  • Schedule recurring crawls on Pro plans via Scheduled Reports.