Scrapy
Technical SEO · scrapy.org verified
Powerful open-source web crawling framework for Python developers to build custom SEO scrapers
Specifications
- Pricing
- open-source
- Price range
- 0
- Billing
- one-time
- License
- BSD
- Platform
- cli
- Languages
- en
- Target user
- expert
- Company size
- small-team, agency, enterprise
- API
- Yes
- Data export
- Yes
- Last update
- 2026-01-30
Tags
Related tools
- 🐍 PySEO
Open-source Python framework for custom scheduled SEO crawling and data extraction
- 🕸️ Apify SEO Crawler
Programmable cloud-based crawler for highly custom scheduled technical SEO audits
- 🚀 Indexing API Tool
Open-source script for bulk-sending URLs to Google’s Indexing API via Google Sheets
- 🏗️ Static Jinja
Open-source library to build static websites with Jinja2 templates
- 🛠️ Hoppscotch
Open-source API development ecosystem used by SEOs to test and debug headless CMS endpoints and schema APIs
- 📦 Meilisearch
Lightning fast open-source search engine API to improve site-search SEO and UX