# Screaming Frog SEO Spider

> Desktop website crawler for technical SEO audits and broken link analysis

Screaming Frog SEO Spider is a desktop crawler that inspects website URLs to diagnose technical SEO problems, audit broken links, and analyze page metadata. It runs locally on your machine and reports on response codes, internal links, headings, and site architecture. It is an essential audit tool for search marketers, offering a free tier that crawls up to 500 URLs per site.

Website: https://screamingfrog.co.uk/

## What it is for

- Audit a website to identify 404 errors, redirects, and broken internal links
- Analyze competitor site architecture, metadata, and heading structures
- Export on-page SEO data and metadata to CSV or Google Sheets

## Features

- Crawl websites locally across Windows, macOS, and Linux
- Identify broken links, errors, and redirect loops
- Review page titles, meta descriptions, and header tags
- Generate XML sitemaps and export structured crawl reports
- Extract web page assets, response codes, and canonical URLs

## Pricing

Freemium. Free version crawls up to 500 URLs; paid annual licence removes URL limits and adds advanced features

## Details

- Type: Desktop app
- Category: [Marketing & Sales](https://xiry.app/topics/marketing-sales.md)
- Open source: no
- Platforms: Windows, macOS, Linux
- For: Technical SEOs, digital marketers, and web developers
- Alternative to: Sitebulb, Ahrefs Site Audit, Semrush Site Audit
- Tags: seo, crawler, technical seo, broken links, site audit

## Why it was saved

- [@edward.builds, 14 March 2025](https://www.instagram.com/reel/DHMNYU5CbpT/): The free version allows crawling up to 500 URLs per site, making it easy to perform technical SEO site audits, export crawl data to CSV/Google Sheets, or spy on competitor page structure.
- [@ronniedigitalmarketing, 19 September 2023](https://www.instagram.com/reel/CxZDMnerM9R/): Allows you to crawl any competitor website to extract their full site structure, total page count, meta descriptions, page titles, sitemaps, and heading tags.

## Related

- [heyTony Site Audit](https://xiry.app/resources/heytony-site-audit): Affordable website audit tool for small business SEO and technical checks (Web app, Paid)
- [tech-seo-audit-skill](https://xiry.app/resources/tech-seo-audit-skill): Claude skill turning raw crawl data into prioritised technical SEO audits (GitHub repo, Open source)
- [OpenSEO](https://xiry.app/resources/openseo): Open-source, self-hosted SEO platform powered by DataForSEO API. (GitHub repo, Open source)
- [Ubersuggest](https://xiry.app/resources/ubersuggest): All-in-one SEO tool for keyword research, site auditing, and competitor analysis (Web app, Freemium)
- [Semrush](https://xiry.app/resources/semrush): All-in-one search marketing, SEO intelligence, and brand visibility platform. (Web app, Paid)
- [AnswerThePublic](https://xiry.app/resources/answerthepublic): Search listening tool mapping consumer questions and search queries visually. (Web app, Freemium)

Updated 3 October 2026. Page: https://xiry.app/resources/screaming-frog-seo-spider

Make your own library: Xiry takes your saved reels, tweets, Reddit bookmarks and Watch Later videos, makes them searchable and pulls the useful stuff out, like this library. It's invite-only for now; join the waitlist at https://xiry.app/#waitlist.