# 18 Web Scraping tools and resources (15 free)

18 Web Scraping resources, picked out of 9 saved Instagram reels and 13 liked tweets, from creators like @digitalsamaritan, @ericciarla, @alexscraping. 15 of them are free, freemium or open source.

## All 18

- [Firecrawl](https://xiry.app/resources/firecrawl-1984): Turn websites and documents into clean, LLM-ready markdown or structured data. (Website, Freemium)
- [Parse](https://xiry.app/resources/parse): Turn any website into a structured REST API using natural language (Web app, Freemium)
- [Apify](https://xiry.app/resources/apify): Cloud platform and marketplace for web scraping, automation, and AI data extraction. (Web app, Freemium)
- [ScrapeGraphAI](https://xiry.app/resources/scrapegraphai): Open-source Python library and API for prompt-based web scraping using LLMs (GitHub repo, Freemium)
- [Chat4Data](https://xiry.app/resources/chat4data): AI Chrome extension for scraping web data using natural language chat prompts. (Browser extension, Freemium)
- [Cloud Scraping Browsers Comparison](https://xiry.app/resources/cloud-scraping-browsers-comparison): Feature and cost breakdown across cloud browser sandbox providers for scraping (Framework, Free)
- [Cloudflare /crawl Endpoint](https://xiry.app/resources/cloudflare-crawl-endpoint): Single API endpoint to crawl entire websites to Markdown, HTML, or JSON (Tip, Freemium)
- [Data Miner](https://xiry.app/resources/data-miner): Browser extension to scrape web tables and lists into CSV files (Browser extension, Freemium)
- [DeepSeek R1 + Firecrawl /extract Workflow](https://xiry.app/resources/deepseek-r1-firecrawl-extract-workflow): A pattern pairing reasoning models with Firecrawl for structured web scraping (Tip, Free)
- [Enabling FIRE-1 in the Firecrawl Scrape API](https://xiry.app/resources/enabling-fire-1-in-the-firecrawl-scrape-api): API configuration pattern for Firecrawl's agent-driven web navigation model (Tip, Freemium)
- [Firecrawl Agent](https://xiry.app/resources/firecrawl-agent): Autonomous web data extraction API driven by prompts without needing explicit URLs. (GitHub repo, Freemium)
- [Gobi](https://xiry.app/resources/gobi): Cloud browser AI agent API to scrape structured data via natural language (Web app)
- [Obscura](https://xiry.app/resources/obscura): Lightweight Rust headless browser for AI agents and web scraping (GitHub repo, Open source)
- [Parallel scraping fleet pattern with Claude Code and boat.dev](https://xiry.app/resources/parallel-scraping-fleet-pattern-with-claude-code-and-boat-de): Pattern for orchestrating mass parallel browser scraping fleets using AI subagents (Tip)
- [Prompt-based web scraping with Firecrawl /extract](https://xiry.app/resources/prompt-based-web-scraping-with-firecrawl-extract): Extract structured web data into JSON using natural language prompts (Tip)
- [Reddit Subreddit JSON Endpoint Trick](https://xiry.app/resources/reddit-subreddit-json-endpoint-trick): Access raw JSON data from any public subreddit by appending .json (Tip, Free)
- [Scrapling](https://xiry.app/resources/scrapling): Adaptive Python web scraping framework with anti-bot bypass and element relocation. (GitHub repo, Open source)
- [Website Content Crawler](https://xiry.app/resources/website-content-crawler): Apify web crawler that extracts clean text and Markdown for LLMs (Web app, Freemium)

More topics in Development: [UI Components](https://xiry.app/topics/development/ui-components.md), [Developer Tools](https://xiry.app/topics/development/developer-tools.md), [Browser Automation](https://xiry.app/topics/development/browser-automation.md), [AI Coding Tools](https://xiry.app/topics/development/ai-coding-tools.md), [AI Coding Prompts](https://xiry.app/topics/development/ai-coding-prompts.md), [Boilerplates & Starters](https://xiry.app/topics/development/boilerplates-starters.md), [AI Coding Workflows](https://xiry.app/topics/development/ai-coding-workflows.md), [AI Workflows](https://xiry.app/topics/development/ai-workflows.md), [Server Security](https://xiry.app/topics/development/server-security.md)

Make your own library: Xiry takes your saved reels, tweets, Reddit bookmarks and Watch Later videos, makes them searchable and pulls the useful stuff out, like this library. It's invite-only for now; join the waitlist at https://xiry.app/#waitlist.