Search Engineer
FirecrawlAI & company
San Francisco, United States$190,000 - $260,000Senior
Y Combinator
Nexus Venture Partners
Zapier
Tobias Lütke
Abhinav Asthana
Matt McClure
Software Engineering
About the role
TL;DR
Build and optimize search infrastructure for Firecrawl.
- •You'll build the systems that let anyone turn the open web into a search index.
- •Firecrawl's search product is one of our fastest-growing surfaces, and we need engineers who can make crawling, ranking, and retrieval fast, reliable, and cheap at scale.
- •Key Responsibilities Design and build the crawling, indexing, and retrieval systems behind Firecrawl Search Push down latency and cost per query while search volume grows Improve ranking quality and freshness for LLM-driven retrieval Own services end to end
- •design, ship, monitor, and iterate in production Work directly with the Head of Search and the rest of the search team on the roadmap Requirements You've built and operated backend or distributed systems at real scale You care about latency, cost, and correctness in equal measure You're comfortable owning ambiguous problems and turning them into shipped systems You move fast and close the loop
- •you'd rather ship, measure, and iterate than perfect on paper
Required skills
PythonElasticsearchKubernetesCI/CDAWSGoogle CloudTerraformGraphQLDockerNginxHAProxyPrometheusGrafanaDatadogNew Relic
Nice-to-have skills
PandasNumPySparkAirflowdbtTableauPower BILookerSnowflakeDatabricks
Domain expertise
ai
Benefits & perks
equity, generous PTO, parental leave, wellness stipend, learning & development, team offsites, sabbatical, full coverage medical, dental, vision, life & disability insurance, supplemental options, Doctegrity telehealth, 401(k) plan, pre-tax benefits, pet insurance, SF HQ perks, E-Bike transportation
Tech stack
PythonElasticsearchKubernetesCI/CDAWSGoogle CloudTerraformGraphQLDockerNginxHAProxyPrometheusGrafanaDatadogNew RelicPagerDutyGitLinuxJiraConfluenceFigmaPostmanSwaggerOpenAPIREST APIgRPCWebSocketsRabbitMQCelerySidekiq