Tools tagged: scraping
All SEO tools tagged with scraping
Showing 93 tools
SingleFile
Chrome extension that saves an entire page into a single HTML file for archiving
Apify for Google Sheets
Connect Apify web scrapers to Google Sheets to automate SERP tracking and website audits without manual exports
Apify SEO Crawler
Programmable cloud-based crawler for highly custom scheduled technical SEO audits
Apify Google Maps Scraper
Highly specialized API for extracting local business data from Google Maps
Apify Google Search Scraper
Serverless web scraping platform to extract data from Google Search results pages at scale
Apify SEO Scrapers
Web scraping actors for SEO data that connect directly to Make scenarios
SerpApi
Real-time search engine results scraper with structured JSON output for Google Bing and Baidu
ZenRows
Scraping API that bypasses anti-bot measures for seamless extraction of SEO and SERP data
ScrapingBee
Web scraping API that handles headless browsers and rotating proxies for SEO data mining
Crawlbase
Advanced crawling and scraping API designed to bypass restricted websites for SEO data
SERPAPI (G0)
High-performance Go library for interacting with major search engine scraping APIs
ScraperAPI
Simple web scraping API that handles proxies browsers and CAPTCHAs with a single call
Apify
Cloud platform for web scraping and data extraction with pre-built SEO and SERP scrapers
Apify JavaScript Rendering
Scalable web scraping and rendering platform for complex JavaScript-heavy websites
Bright Data
Global proxy network for localized SERP scraping and geo-validation
Bright Data SERP API
Global proxy network infrastructure for large-scale SERP data collection and real-time analysis
Browse AI
No-code web scraper and monitor that automates competitor tracking and data extraction
Evaboot
LinkedIn Sales Navigator scraper that cleans data and extracts verified professional emails
HARPA AI
AI-powered automation for web monitoring data extraction and ChatGPT integration in browser
ImportFromWeb
Scrape SEO data, prices, and metadata from any website directly into Google Sheets using custom XPaths or CSS selectors
Instant Data Scraper
Extract data from tables and listing pages into Excel or CSV automatically
Oxylabs SERP Scraper API
Enterprise-grade API for extracting structured data from major search engines with high success
Oxylabs Web Scraper API
The ultimate scraping API for bypass of modern anti-scraping systems across any site
ScaleStack
Enterprise data infrastructure for SEO teams needing high-volume SERP and web extraction
Serper.dev
Fast and low-cost Google Search API for scraping organic results and local maps data
Wiza
Scrapes LinkedIn Sales Navigator and finds verified work emails for B2B lead generation
Scrapy
Powerful open-source web crawling framework for Python developers to build custom SEO scrapers
Selenium
Industry standard framework for browser automation and functional web testing
Requests-HTML
Pythonic HTML parsing for humans with JavaScript support for easy SEO scraping
Bleach
HTML sanitizing library that can be used to clean scraped content for SEO
Trafilatura
Python package and command-line tool to gather text and metadata on the web
Extruct
Python library for extracting structured data from HTML files supporting Microdata and JSON-LD
Diffbot
AI-powered web scraping and knowledge graph API for automated SEO content analysis
Scraper (Chrome)
Simple data mining extension that facilitates harvesting link opportunities from SERPs
Beautiful Soup
Library for pulling data out of HTML and XML files for rapid SEO audit script development
Captain Data
Automation platform that connects LinkedIn with hundreds of tools to build complex SEO workflows
Data Miner
Scrape data from any website into Google Sheets or Excel with one click
Data-Miner.io
Browser extension for scraping SEO data and lists directly from your web browser
Gnu-Wget
Command-line utility for retrieving files using HTTP/HTTPS frequently used for site mirroring
Netpeak Spider
Personalized crawler for day-to-day SEO audits and comprehensive technical site analysis
Octoparse
No-code web scraper to collect link prospects from directories and social media
ParseHub
Powerful desktop-based web scraper capable of extracting data from complex AJAX-heavy websites
Phantombuster TikTok
Automation tool for scraping TikTok data for lead generation and keyword research
Promptcloud SERP API
Managed web scraping service that delivers search data directly into S3 or Dropbox
ProxyCrawl
All-in-one crawling and scraping tool for SEO projects requiring anonymous data access
ProxyCrawl (Crawlbase) API
Suite of APIs for crawling and scraping search engines with built-in anonymity features
SEO Tools for Excel
Excel add-on for scraping data and connecting to SEO APIs directly within spreadsheets for custom reporting
ScrapeBox
The Swiss Army Knife of SEO for link prospecting harvesting and automated technical tasks
Scraper (Extension)
Extracts data from web pages into spreadsheets for link prospecting or audits
Screaming Frog Custom Extraction
Use regex to audit internal routing, canonical tags, and structural SEO linking patterns
Srapebox Email Scraper
Extract emails from any website for outreach
Yandex Search API
Service for programmatic access to Yandex search results for data-driven SEO
Zennoposter
All-in-one automation tool for web browser tasks and SEO
Zyte
Professional data extraction platform with smart proxy management and automated browser rendering
ScrapeGraphAI
Open-source Python library for scraping search results using Large Language Models
Proxy-List
Automated script to fetch and check live proxies for scraping and automation
Serp-Explorer
Open-source rank tracker that scrapes search results without expensive proxies
Serp-Api-Open
Community project to scrape SERP data for keyword research without costs
Search Engine Scanner
Fast open-source CLI for scraping search engine results
Serply
Open-source Python library for scraping search engine results for SaaS dev teams
Search-One Local SEO Tool
Open-source repository for scraping local search results and identifying competitors
Search-Engine-Scraper
Python script to scrape search engine results for rank tracking and analysis
Answer-The-Public-Scraper
Python script to scrape autocomplete suggestions for "People Also Ask" style research
Search engine keywords
CLI tool for fetching keyword suggestions from various search engine autocomplete APIs
Local Search Data
Open-source scraper for extracting local business data from maps
Bot-Solver API
Niche API for solving complex captchas and bot detection hurdles in SEO scraping
HasData
Unified API platform for SERP extraction social media data and web scraping services
Hexomatic
No-code web scraping and work automation platform for SEO lead gen
OpenText Link
A developer-focused backlink analysis API for large-scale data processing
Proxy-Store SERP
Dedicated proxy provider for SEO tools with endpoints optimized for search scraping
ProxyEmpire
Residential and mobile proxies for geo-specific SERP testing
Scraper.AI
No-code web scraping tool that automates data extraction from SERPs and websites
SerpApi.io
Simplified SERP scraping for developers needing Google Shopping News and Local results
Serpdog
High-performance Google Search API with built-in proxy rotation and captcha solving
Shenjian (Spider)
Cloud-based web scraping and data extraction tool optimized for Chinese e-commerce and Baidu
WebScraping.AI
Simpler web scraping API with built-in GPT-4o capabilities for SEO content parsing
Pyppeteer
Python port of Puppeteer for rendering JavaScript-heavy pages for SEO audits
Subreddit Analysis
A Python-based tool for scraping and analyzing subreddit data for SEO and linguistic patterns
Scrapy-Selenium
Middleware for Scrapy to handle JavaScript pages using Selenium for SEO
Ubersuggest-Open
Community maintained scraper for keyword suggestions and search volume data
SEO-Scraper-JS
High-performance Javascript scraper designed to extract SEO metrics and meta data from large batches of URLs
Serp-Api (Open Source)
Self-hosted SERP scraping API using Puppeteer and Node.js for private data pipelines
Favicon-Fetch
Node.js package that efficiently finds and downloads the best quality favicon for any given URL
Yandex Search Result Scraper
Python library to scrape and parse Yandex search engine results pages effectively
Google Drive Sitemap Scraper
Script that scrapes URLs from lists in Google Drive to perform status code checks
Geolead
LinkedIn scraper that finds leads based on specific geographic SEO locations
Keyword Shitter
Simple tool that generates thousands of keyword ideas by bulk-scraping Google autocomplete results
Keyword Snatcher
Tool for generating thousands of long-tail keywords from multiple search engine sources
RocketSERP
Cloud-based API for large scale SERP data extraction with high concurrency support
ScrapeStack
Real-time web scraping API with 35+ million proxies for reliable SEO data gathering
ScraperBox
Scraping API with automatic browser rotation and residential proxies for SEO
Search-API.com
High-performance Google Search scraper providing real-time data for rankings and ads
TexAu
Powerful automation platform to scale LinkedIn engagement and data collection workflows