Marketing & Sales · Desktop app
Screaming Frog SEO Spider
Desktop website crawler for technical SEO audits and broken link analysis
Screaming Frog SEO Spider is a desktop crawler that inspects website URLs to diagnose technical SEO problems, audit broken links, and analyze page metadata. It runs locally on your machine and reports on response codes, internal links, headings, and site architecture. It is an essential audit tool for search marketers, offering a free tier that crawls up to 500 URLs per site.
What it's for
- Audit a website to identify 404 errors, redirects, and broken internal links
- Analyze competitor site architecture, metadata, and heading structures
- Export on-page SEO data and metadata to CSV or Google Sheets
Features
- Crawl websites locally across Windows, macOS, and Linux
- Identify broken links, errors, and redirect loops
- Review page titles, meta descriptions, and header tags
- Generate XML sitemaps and export structured crawl reports
- Extract web page assets, response codes, and canonical URLs
Pricing
Freemium. Free version crawls up to 500 URLs; paid annual licence removes URL limits and adds advanced features
Details
- Type
- Desktop app
- Category
- Marketing & Sales
- Topic
- SEO Auditing
- Open source
- No
- Platforms
- Windows, macOS, Linux
- For
- Technical SEOs, digital marketers, and web developers
- Alternative to
- Sitebulb, Ahrefs Site Audit, Semrush Site Audit
- Tags
- seo, crawler, technical seo, broken links, site audit
Why it was saved
- @edward.builds: The free version allows crawling up to 500 URLs per site, making it easy to perform technical SEO site audits, export crawl data to CSV/Google Sheets, or spy on competitor page structure.
- @ronniedigitalmarketing: Allows you to crawl any competitor website to extract their full site structure, total page count, meta descriptions, page titles, sitemaps, and heading tags.
Related
Affordable website audit tool for small business SEO and technical checks
Claude skill turning raw crawl data into prioritised technical SEO audits
Open-source, self-hosted SEO platform powered by DataForSEO API.
All-in-one SEO tool for keyword research, site auditing, and competitor analysis
All-in-one search marketing, SEO intelligence, and brand visibility platform.
Search listening tool mapping consumer questions and search queries visually.
Updated