AI Awesome

Discover the Best AI Tools

Your ultimate directory for finding the right artificial intelligence solutions for any task.

AI Web Scraping(13)

Mpaid
MarcinDudekDev/the-data-collector
A MCP server for scraping Hacker News, Bluesky, and Substack with x402 micropayment support.
AI Web Scraping
hn_searchbluesky_searchsubstack_search+1
Afree
aparajithn/agent-scraper-mcp
Web scraping MCP server for AI agents with multiple tools.
AI Web Scraping
clean content extractionstructured scraping with CSS selectorsfull-page screenshots via Playwright+3
Sopen source
Steel Browser
Steel Browser is an open-source browser infrastructure for AI agents with session-backed automation, extraction, screenshots/PDFs, an AI-native CLI, and a reusable skill.
AI Web Scraping
session-backed automationextraction capabilitiesscreenshots and PDF generation+2
Bopen source
BrowserGym
BrowserGym is a gym-style benchmark and environment toolkit for evaluating browser-using web agents.
AI Web Scraping
Gym-style benchmarking for web agentsEnvironment toolkit for browser evaluations
Bopen source
browser-use
Enable AI agents to control websites through a structured and reproducible browser interface.
AI Web Scraping
structured browser interfacereproducible browser controlai agent compatibility
Aunknown
apify/agent-skills
Official Apify skills for web scraping, data extraction, and automation.
AI Web Scraping
web scraping toolsdata extraction capabilitiesautomation solutions
Wopen source
webpeel/webpeel
Webpeel is an AI-powered web fetcher designed for agents with auto-escalation capabilities.
AI Web Scraping
fetches data from HTTPescalates to headless browseroperates in stealth mode+1
Wopen source
webscraping-ai/webscraping-ai-mcp-server
A server for AI-powered web scraping tasks.
AI Web Scraping
AI-driven scrapingserver-based architecturecustomizable scraping rules
Sopen source
scrapeless-ai/scrapeless-mcp-server
Scrapeless MCP Server is an open-source AI-powered server for web scraping.
AI Web Scraping
AI-powered web scrapingserver-based architecturecustomizable scraping tasks
Popen source
PhungXuanAnh/selenium-mcp-server
Selenium MCP Server is an open-source tool designed for web scraping using Selenium WebDriver.
AI Web Scraping
Selenium WebDriver integrationcustom web scraping scriptsheadless browser automation
Munknown
modelcontextprotocol/server-puppeteer
A tool for web scraping using Puppeteer within the ModelContextProtocol framework.
AI Web Scraping
automated web scrapingPuppeteer integrationdata extraction
Bopen source
brutalzinn/simple-mcp-selenium
A simple tool for creating web scraping projects using Selenium.
AI Web Scraping
easy setupSelenium integrationcustomizable scripts
Sopen source
Selenium-Agent
Selenium-Agent is an open-source tool for automating web scraping using Selenium.
AI Web Scraping
automated web scrapingSelenium integrationeasy to use