AI Awesome

Discover the Best AI Tools

Your ultimate directory for finding the right artificial intelligence solutions for any task.

AI Web Scraping(17)

Sunknown
scraperapi/scraperapi-mcp
MCP server for ScraperAPI web scraping with JavaScript rendering, geotargeting, premium proxies, and auto-parsing support.
AI Web Scraping
JavaScript renderinggeotargetingpremium proxies+1
Mopen source
markmircea/Selenix-MCP-Server
MCP server bridging Claude Desktop with Selenix for browser automation and testing through natural language.
AI Web Scraping
Create, run, debug, and manage browser testsNatural language interface for browser automation
Uopen source
urldna/mcp
MCP is an open-source server for automated URL scanning and forensic phishing triage.
AI Web Scraping
Captures full DOM snapshotsRecords network requestsTakes visual screenshots+1
Oopen source
ofershap/mcp-server-scraper
Web scraping tool to extract clean markdown, links, and metadata from any URL.
AI Web Scraping
extracts markdownextracts linksextracts metadata
Mpaid
MarcinDudekDev/the-data-collector
A MCP server for scraping Hacker News, Bluesky, and Substack with x402 micropayment support.
AI Web Scraping
hn_searchbluesky_searchsubstack_search+1
Afree
aparajithn/agent-scraper-mcp
Web scraping MCP server for AI agents with multiple tools.
AI Web Scraping
clean content extractionstructured scraping with CSS selectorsfull-page screenshots via Playwright+3
Sopen source
Steel Browser
Steel Browser is an open-source browser infrastructure for AI agents with session-backed automation, extraction, screenshots/PDFs, an AI-native CLI, and a reusable skill.
AI Web Scraping
session-backed automationextraction capabilitiesscreenshots and PDF generation+2
Bopen source
BrowserGym
BrowserGym is a gym-style benchmark and environment toolkit for evaluating browser-using web agents.
AI Web Scraping
Gym-style benchmarking for web agentsEnvironment toolkit for browser evaluations
Bopen source
browser-use
Enable AI agents to control websites through a structured and reproducible browser interface.
AI Web Scraping
structured browser interfacereproducible browser controlai agent compatibility
Aunknown
apify/agent-skills
Official Apify skills for web scraping, data extraction, and automation.
AI Web Scraping
web scraping toolsdata extraction capabilitiesautomation solutions
Wopen source
webpeel/webpeel
Webpeel is an AI-powered web fetcher designed for agents with auto-escalation capabilities.
AI Web Scraping
fetches data from HTTPescalates to headless browseroperates in stealth mode+1
Wopen source
webscraping-ai/webscraping-ai-mcp-server
A server for AI-powered web scraping tasks.
AI Web Scraping
AI-driven scrapingserver-based architecturecustomizable scraping rules
Sopen source
scrapeless-ai/scrapeless-mcp-server
Scrapeless MCP Server is an open-source AI-powered server for web scraping.
AI Web Scraping
AI-powered web scrapingserver-based architecturecustomizable scraping tasks
Popen source
PhungXuanAnh/selenium-mcp-server
Selenium MCP Server is an open-source tool designed for web scraping using Selenium WebDriver.
AI Web Scraping
Selenium WebDriver integrationcustom web scraping scriptsheadless browser automation
Munknown
modelcontextprotocol/server-puppeteer
A tool for web scraping using Puppeteer within the ModelContextProtocol framework.
AI Web Scraping
automated web scrapingPuppeteer integrationdata extraction
Bopen source
brutalzinn/simple-mcp-selenium
A simple tool for creating web scraping projects using Selenium.
AI Web Scraping
easy setupSelenium integrationcustomizable scripts
Sopen source
Selenium-Agent
Selenium-Agent is an open-source tool for automating web scraping using Selenium.
AI Web Scraping
automated web scrapingSelenium integrationeasy to use