What it does
Screaming Frog SEO Spider is a Windows, Mac and Linux crawler for examining URLs, response codes, titles and indexing directives. It finds broken links, redirects and duplicated page details. The free version crawls up to 500 URLs; an annual licence adds larger crawls and advanced tools.
Find the pages behind a technical problem
SEO Spider runs on your computer and lists individual URLs from a crawl. The Response Codes, Page Titles, Meta Description and Directives tabs separate different checks. Broken-link exports include the pages containing the links, which helps a developer locate the problem.
The crawler also creates XML sitemaps and diagrams of internal links. Licensed features include JavaScript rendering, scheduled audits, crawl comparisons and connections to Google Analytics, Search Console and PageSpeed Insights.
Free download or annual licence?
The free edition stops at 500 URLs and cannot save crawls or render JavaScript. A paid licence costs GBP 199 per user per year. The paid crawl limit depends on your computer's available memory and storage.
Download and install the application, enter a homepage in Enter URL to spider, then click Start. The free edition needs no licence activation. For a website migration, saved crawls and comparisons make the paid edition relevant: you can compare old and new URLs rather than relying on a single crawl after launch.
Strengths
- Runs on Windows, Mac and Linux
- Broken-link exports include the linking page
- The free download can audit up to 500 URLs
Watch out for
- Saving crawls, JavaScript rendering and scheduling need a licence
- Large crawls use your computer's memory and disk space
Best for
- Developers locating broken links and indexing directives
- Technical SEO specialists comparing sites before and after a migration
Sources
- Screaming Frog SEO Spider (Oct 27, 2026)
- SEO Spider pricing and feature comparison (Oct 27, 2026)
- SEO Spider getting started guide (Oct 27, 2026)