Firecrawl做開發索引

Introducing the Firecrawl Developer Index, built for supercharging coding agents.Read the announcement →Developer Search IndexTechnical docs searchfor coding agents70M+ docs, READMEs, issues, and merged pull requests in one index, with the highest recall of any coding-specific index.

$npx -y firecrawl-cli@latest setup developer-indexCopy skillView docs$ firecrawl developer "why is my retry backoff not firing on 429" --limit 10$ firecrawl developer "why is my retry backoff not firing on 429" --limit 10issue:sidekiq/sidekiq#1471Retries are not applied to 429 responsesThe client treats 429 as a terminal status, so backoff never runs.

pullrequest:aws/aws-sdk-js-v3#2384fix(retry): honor Retry-After on 429Adds 429 to the throttling error list so the standard retry applies.doc:docs.stripe.com/rate-limitsRate limitsHandle 429 responses with an exponential backoff before each retry.

Primary sources70M+Primary sourcesMost sources refreshedDailyMost sources refreshedPlus an MCP server1 APIPlus an MCP serverTo get startedNo API keyTo get started//Inside the index//The libraries your agentsask about70M+ technical docs[ NOT EXHAUSTIVE ]Next.jsReactVueSvelteAngularAstroRemixNuxtNode.

jsDenoBunViteTailwind CSSPlaywrightExpoNext.jsReactVueSvelteAngularAstroRemixNuxtNode.jsDenoBunViteTailwind CSSPlaywrightExpoTypeScriptPythonRustGoSwiftKotlin.NETFlutterDjangoFastAPIFlaskRailsLaravelSpringtRPCTypeScriptPythonRustGoSwiftKotlin.

NETFlutterDjangoFastAPIFlaskRailsLaravelSpringtRPCPostgreSQLRedisMongoDBSQLiteSupabasePrismaKubernetesDockerTerraformCloudflareKafkaGraphQLPyTorchOpenAIPostgreSQLRedisMongoDBSQLiteSupabasePrismaKubernetesDockerTerraformCloudflareKafkaGraphQLPyTorchOpenAISources70M+TypesREADMEs · issues · PRs · docs · specsBrowse the docs[ 01 / 04 ]·Features//Built for coding agents//The sources your agent needs,ranked and ready70M+ artifactsPrimary sources, not web pages.

READMEs, issues, merged pull requests, docs, and OpenAPI specs.readme:vercel/next.jsissue:sidekiq/sidekiq#1471pullrequest:pydantic/pydantic#8291doc:docs.stripe.com/webhooksSkill, CLI, MCP, and APIOne line into any agent.Claude Code, Cursor, and Codex search the index on their own.

terminal$npx -y firecrawl-cli@latest \ setup developer-index✓firecrawl-developer-index readyWired intoClaude CodeCursorCodexMCPMatched passagesThe answer, not just the link.Matched passages come back as markdown, so there is no second scrape.issue:sidekiq/sidekiq#1471github.

com/sidekiq/sidekiqmatched passagemarkdownThe client treats 429 as terminal, so theSemantic retrievalAsk the way you'd ask a person.Paste an error message, get the thread that solved it.

why is my retry backoff not firing on 429Top matchesissue:sidekiq/sidekiq#1471#1pullrequest:aws/aws-sdk-js-v3#2384#2doc:docs.stripe.com/rate-limits#3Continuous refreshToday's thread, not last quarter's.Most sources land within a day of publishing.index refreshlivegithub.com/vercel/next.

jsjust nowdocs.stripe.com1 hr agogithub.com/pydantic/pydantic18 min agodocs.astral.sh/uv4 min agoRich filtersScope it down to one repo.Filter by type, repo, language, topic, license, or stars.narrow the indextypes:issuerepos:vercel/next.jslanguage:Rustminstars:1000license:MITsources:docs.stripe.

com70M+→↓26.2Mresults[ 02 / 04 ]·Benchmarks//DevDex, an open benchmark//The highest recall of anycoding-specific index1,179 real developer queries.Scored deterministically, no model judge.Recall@10, all tracks combined[ HIGHER IS BETTER ]Firecrawl Developer Index0.63Firecrawl Search0.58Parallel0.

57Mintlify0.54Exa0.54Context7docs only0.17Native web search0.45Native web search is the control.With no search tool, the same model scores 0.01.Repository discoveryTrails0.76Find the repo behind a capability, without its name.Best on this track: Parallel·0.82Issues & pull requestsLeads0.

66Find the bug report and the PR that fixed it.Next best: Parallel·0.63Documentation lookupTied0.47Find the page that answers a how-to question.Statistically tied with Context7·0.47Queries1,179Tracks3DriverClaude Opus 4.

8JudgeNoneRun it yourselfTrusted by 150,000+ companies of all sizesRead storyRead storyRead storyRead storyRead storyRead storyRead storyRead story[ 03 / 04 ]·For AI agents//For AI agents//Built into the AI toolsyou already useUse Firecrawl from Claude Code Cursor Windsurf and the agent harnesses your team already runs.

One command.Connect your agent to Firecrawl via our Skills/CLI or MCP.SkillMCPnpx -y firecrawl-cli@latest init --all --browserView the docsAgent onboarding.Are you an AI agent?Fetch this skill to get an API key and start building.cURLcurl -s https://firecrawl.dev/agent-onboarding/SKILL.

mdView the skillcURLCLISkillPythonNode.jsCopycurl -X POST \ https://api.firecrawl.

dev/v2/search/developer \ -H "Content-Type: application/json" \ -d '{ "query": "retry backoff not firing on 429", "k": 10, "types": ["issue", "pullrequest"] }'npm install -g firecrawl-cli firecrawl developer "retry backoff not firing on 429" # Or pipe it into your own tooling firecrawl developer "add pydantic with uv" --jsonnpx -y firecrawl-cli@latest setup developer-index # That is the whole setup.

Your agent can now # search 70M+ READMEs, issues, PRs, and docs: # # > find the PR that fixed the 429 retry bugfrom firecrawl import Firecrawl firecrawl = Firecrawl(apikey="fc-YOUR-API-KEY") result = firecrawl.

search( "retry backoff not firing on 429", categories=["developer"], limit=10, ) for item in result.developer or []: print(item.url, item.title)import { Firecrawl } from "firecrawl"; const firecrawl = new Firecrawl({ apiKey: "fc-YOUR-API-KEY", }); const result = await firecrawl.

search( "retry backoff not firing on 429", { categories: ["developer"], limit: 10 }, ); for (const item of result.developer ??[]) { console.log(item.url, item.title); }No API key.Send one for higher rate limits.

[ 04 / 04 ]·FAQ//FAQ//Frequently asked questionsGeneralWhat is the Firecrawl Developer Index?Why not just use web search?What exactly is in the index?How fresh is the data?Using itHow do I call the Developer Index?Do I need an API key?Is there a Python or Node SDK method?

How do I give my coding agent access?What can I filter on?Benchmarks & pricingWhat is DevDex?Can I reproduce the results?How much does it cost?Is it generally available?