Screaming Frog SEO Spider is a desktop website crawler that audits a site for over 300 SEO issues. It runs on Windows, macOS and Linux, and its purpose is to help improve both SEO and UX. This page explains what the crawler covers, who it suits and where it sits among SEO tools.
- Tool
- Screaming Frog SEO Spider
- Made by
- Screaming Frog
- Official sources
- screamingfrog.co.uk/seo-spider
- Category
- SEO tools
- Checked
- 22 November 2026
Who makes Screaming Frog SEO Spider
Screaming Frog SEO Spider is made by Screaming Frog. The official website for the product is linked below, and it is the place to confirm current details about the software.
What Screaming Frog SEO Spider is for
The SEO Spider is built to crawl a website and report what it finds, so that technical problems can be identified and fixed. It audits a site for over 300 SEO issues, which gives a single crawl a wide scope: broken links, redirects, page titles, duplicate content, crawl directives and more.
Because it is a desktop application rather than a hosted service, it runs on your own machine. It is available on Windows, macOS and Linux, so it fits into most working environments used by SEO professionals.
Who Screaming Frog SEO Spider is for
The vendor names its audience as SEOs, agencies and technical SEO auditors. These are people who need to inspect a site at the level of individual URLs, directives and page elements, and who often need to repeat that work across many sites.
The scheduling, automation and export options described below also suit teams that want crawls to run on a regular basis and feed into other reporting, rather than being started by hand each time.
Notable capabilities
The SEO Spider combines site auditing, data extraction, integrations and automation in one crawler. The capabilities below are the ones the vendor highlights.
- Broken links and server errors: it finds them and lets you bulk export them together with their source URLs, so you can see where each problem originates.
- Redirects: it identifies redirects, redirect chains and loops, and can audit a URL list as part of a site migration.
- Page titles and meta descriptions: it analyses them for length, missing and duplicate issues.
- Duplicate and thin content: it detects exact duplicate pages with an md5 check, as well as partially duplicated elements and low content pages.
- Custom extraction: it can pull custom data from page HTML using CSS Path, XPath or regex.
- Crawl directives: it reports on URLs blocked by robots.txt, meta robots or X-Robots-Tag directives.
- JavaScript rendering: an integrated Chromium WRS lets it render JavaScript-heavy sites, supporting frameworks such as Angular, React and Vue.js.
- Sitemaps: it generates XML Sitemaps and Image XML Sitemaps with configurable options.
How Screaming Frog SEO Spider fits SEO tools
SEO work usually involves several kinds of tools: ones that look at how a site is built, ones that report on search and traffic data, and ones that describe a site's links from elsewhere. The SEO Spider sits mainly in the first group, but it also connects to the others. It integrates with the Google Analytics, Search Console and PageSpeed Insights APIs, and it can pull external link metrics from Majestic, Ahrefs and Moz, so crawl data can be viewed alongside those sources.
It also supports comparison and workflow tasks. It can compare crawls, and compare staging against production environments. Crawls can be scheduled, auto-exported, including to Google Sheets, and automated via command line. It can crawl as search bots, AI crawlers or a custom user-agent, and it offers AI integration with OpenAI, Gemini, Anthropic and Ollama. For site structure, it provides interactive site architecture visualisations.
Within Guidehurst's wider niche of software and business tools across many categories, the SEO Spider is an example of a specialist technical tool: it does one job, auditing a site's structure and content from the outside, and leaves broader marketing, analytics or content work to other categories of software.
Common questions
What is Screaming Frog SEO Spider used for?
It is used to crawl a website and audit it for over 300 SEO issues, including broken links, redirects, duplicate pages, and problems with page titles and meta descriptions.
Who develops Screaming Frog SEO Spider?
It is developed by Screaming Frog, whose official site for the product is linked on this page.
Which operating systems does Screaming Frog SEO Spider support?
It runs on Windows, macOS and Linux.
Can Screaming Frog SEO Spider crawl JavaScript sites?
Yes. It renders JavaScript-heavy sites using an integrated Chromium WRS and supports frameworks such as Angular, React and Vue.js.
Does Screaming Frog SEO Spider connect to other data sources?
Yes. It integrates with the Google Analytics, Search Console and PageSpeed Insights APIs, and can pull external link metrics from Majestic, Ahrefs and Moz.
Related guides
Sources checked
Checked 22 November 2026 (Asia/Dhaka):
Guidehurst is independent and not affiliated with Screaming Frog. Product names belong to their owners.