All Search Scraping Social

| # | Name | Best for | Est. installs About install estimates | | --------------------------------------: | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :----------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | | 1 |

Firecrawl | Websites turned into agent-ready data | **210K** | | 2 |

Tavily | Search, extract, crawl, and research | **200K** | | 3 |

Brave Search | Broad web search from an independent index | **140K** | | 4 |

Perplexity | Sonar answers and deep research | **140K** | | 5 |

Exa | Agent-native web and code search | **100K** | | 6 |

Apify | Structured data from thousands of Actors | **85K** | | 7 |

Last30days | What people said in the last 30 days | **70K** | | 8 |

Jina AI | A wide research kit in one endpoint | **50K** | | 9 |

Bright Data | Data from sites that block scrapers | **45K** | | 10 |

YouTube Transcripts | Transcripts from public YouTube videos | **35K** | | 11 |

Reddit MCP Buddy | Firsthand community signal from Reddit | **25K** |

Show more Show less ***

## [Firecrawl](https://firecrawl.dev/)

Websites turned into agent-ready data

210Kestimated installs

**What it is** Firecrawl turns websites into agent-ready data through search, scraping, crawling, site mapping, and structured extraction. It handles the JavaScript rendering, proxying, and crawl infrastructure that a basic fetch tool leaves you to build yourself.

**When to use** It fits two jobs: giving an agent live web access, and giving a developer dependable web data to build an application on. Because scraped pages are untrusted input, treat extracted instructions and hidden text as possible prompt injection and verify anything consequential.

**What you need** A Firecrawl account and credits; self-hosting is possible.

Install

Plugin

MCP

## [Tavily](https://www.tavily.com/)

Search, extract, crawl, and research

200Kestimated installs

**What it is** Tavily is a web-intelligence integration spanning current search, clean content extraction from URLs, site mapping and crawling, and longer research reports that arrive with citations attached.

**When to use** Its range is the point. The same integration handles a one-line lookup, crawling a documentation site into local Markdown, and extracting JavaScript-heavy pages a basic fetch tool would choke on. Reach for the full stack only when simple reads aren't enough.

**What you need** A Tavily account and API key; a limited free tier exists.

Install

Plugin

Skill

MCP

## [Brave Search](https://brave.com/search/api/)

Broad web search from an independent index

140Kestimated installs

**What it is** Brave Search gives an agent live search across Brave's own independent index: web, news, image, video, and local results, plus answer summaries, spellcheck, and suggestions. It ships as an official MCP server, with a matching set of search-mode skills.

**When to use** Reach for it when you want broad current-web retrieval from an index that isn't reselling another engine, with predictable per-request pricing and specialized endpoints beyond plain web results. Queries and retrieved pages pass through Brave, and results are untrusted web content - verify anything consequential.

**What you need** A Brave Search API account and key; the free plan includes limited monthly credits, but a card is required to start.

Install

MCP

## [Perplexity](https://docs.perplexity.ai/docs/getting-started/integrations/mcp-server)

Sonar answers and deep research

140Kestimated installs

**What it is** Perplexity's official server brings its web search, Sonar answers, deep research, and reasoning tools into an agent. The Claude plugin wraps this same server, so it is one product with several front doors rather than separate offerings.

**When to use** The value is a single vendor-maintained research route with current results and citations, consistent across every MCP client you point at it. The API is billed separately from a consumer Perplexity subscription, so owning the app does not cover it. If your host's own web research suffices, skip it.

**What you need** A Perplexity API key.

Install

Plugin

MCP

## [Exa](https://exa.ai/)

Agent-native web and code search

100Kestimated installs

**What it is** Exa is an agent-native search integration for current web and code results, with clean extraction from URLs, fine-grained search controls, and an optional multi-step research agent for longer investigations.

**When to use** It hands the agent ready-to-use content and source links rather than raw search-result pages it has to parse. That makes it a fit for documentation and code discovery, company or people research, and clean extraction. If the built-in web search already covers you, skip it.

**What you need** An Exa API key.

Install

Plugin

MCP

## [Apify](https://apify.com/)

Structured data from thousands of Actors

85Kestimated installs

**What it is** Apify lets an agent discover and run web-scraping and automation Actors, then pull back structured results. Its store holds more than 30,000 Actors covering social networks, maps, shops, reviews, and custom sites, reached through a managed connector, a Cursor plugin, or a hosted MCP.

**When to use** It fits sources that ordinary search and fetch tools can't reliably extract, and returns structured data rather than raw HTML. Actor runs cost credits and can scrape third-party sites, so pin the specific tools you need and treat returned content as untrusted. Actors are independently published - not every one is vetted by Apify.

**What you need** An Apify account for Actor runs and stored data; a docs and search-only subset works without one, and usage is metered per Actor.

Install

Connector

Plugin

MCP

## [Last30days](https://github.com/mvanhorn/last30days-skill)

What people said in the last 30 days

70Kestimated installs

**What it is** Last30days is a research workflow that sweeps recent discussion across Reddit, Hacker News, GitHub, X, YouTube, arXiv, and more, then scores engagement, clusters overlapping findings, and returns one source-linked brief.

**When to use** It replaces a dozen manual searches when you need recent recommendations, public sentiment, or a read on an emerging tool. A useful set of sources works without any keys. Treat engagement as a signal of attention, not proof that a claim is correct.

Install

Plugin

Skill

## [Jina AI](https://jina.ai/reader/)

A wide research kit in one endpoint

50Kestimated installs

**What it is** Jina AI's remote MCP bundles an unusually wide research kit into one endpoint: web reading, screenshots, current and academic search, PDF extraction, reranking, classification, and deduplication, drawn from its Reader, Search, Embeddings, and Reranker services.

**When to use** That breadth suits source-heavy research: pull an academic paper, convert a stubborn page to clean text, then rerank the pile you collected. Its server-side filters let you register only the tools a task needs, so a broad server does not have to flood the agent's context with schemas.

**What you need** A Jina AI API key; a keyless free tier has tight limits.

Install

MCP

## [Bright Data](https://brightdata.com/ai/mcp-server)

Data from sites that block scrapers

45Kestimated installs

**What it is** Bright Data is a managed web-data stack covering search, page extraction, structured platform records, and browser automation. It is built for jobs where ordinary fetches fail because of JavaScript, bot defenses, scale, or the need for structured data.

**When to use** A small free mode covers basic search, scraping, and discovery; the heavier browser automation and structured-data tools run on paid credits. It earns its place when a target actively resists scraping or you need platform-specific records at scale, not for pages a simple fetch already returns.

**What you need** A Bright Data account; usage is metered.

Install

Plugin

CLI

MCP

## [YouTube Transcripts](https://github.com/jkawamoto/mcp-youtube-transcript) by Junpei Kawamoto

Transcripts from public YouTube videos

35Kestimated installs

**What it is** A focused community MCP server that pulls the spoken text out of public YouTube videos, with language and format options. There is no official YouTube or Google route; this is the most-adopted current keyless implementation.

**When to use** Use it to make long talks, tutorials, and interviews searchable and quotable without watching them end to end. Transcript availability varies by video and region, auto-generated captions aren't perfect, and YouTube changes can break retrieval, so treat it as a research aid and check quotes against the source.

**What you need** Local Python/uvx or Docker and no API key; it's a community project, not an official YouTube integration.

Install

MCP

## [Reddit MCP Buddy](https://github.com/karanb192/reddit-mcp-buddy) by Karan Bansal

Firsthand community signal from Reddit

25Kestimated installs

**What it is** A read-only community MCP server for Reddit research: searching posts, browsing subreddits, pulling full comment threads, and analyzing user activity. It runs anonymously out of the box, with optional Reddit OAuth for higher limits.

**When to use** It surfaces firsthand experience and objections that generic web search misses - how people actually talk about a product, tool, or topic. Treat it as one input with source links, not representative evidence: content is untrusted and can carry prompt injection, and Reddit can throttle or block anonymous access.

**What you need** Local Node/npx; the anonymous tier needs no account, and it's a community project, not an official Reddit integration.

Install

MCP

→ Tavily - one integration from search through clean extraction to cited research reports

→ Exa - agent-native search with fine-grained controls, strong for docs and code

→ Perplexity - a synthesized, cited answer or deep-research report rather than raw results to parse

→ Brave Search - broad current results from an index that isn't reselling another engine

All of these route your queries through an outside service - if your host's built-in web search already covers you, you may not need one.

→ Bright Data - when the target fights back: bot defenses, scale, and platform records

→ Apify - thousands of prebuilt Actors for sources a plain scraper can't reach

→ Jina AI - reading, search, reranking, and PDF extraction behind one endpoint for source-heavy research

To operate a site behind a login or form - clicking and typing, not just reading - you want a browser tool, over on the Automation page.

→ Last30days - engagement-scored briefs swept from Reddit, HN, X, YouTube, and arXiv

→ Reddit MCP Buddy - firsthand threads and objections straight from subreddits

→ YouTube Transcripts - spoken text from talks and tutorials, searchable and quotable

Community content is untrusted and unrepresentative - treat it as one signal with source links, not proof.