Research Engineer, LangSmith Engine
LangChainLLM Orchestration company
New York, United StatesSenior
Sequoia Capital
Benchmark
IVP
Amplify Partners
CapitalG
Sapphire Ventures
Data & AI
About the role
TL;DR
Research Engineer to improve LangSmith Engine agent capabilities and efficiency.
- •We’re looking for an experienced research engineer to help make the LangSmith Engine agent more capable and efficient.
- •You’ll study agent failures, build benchmarks, run experiments, and turn successful ideas into production.
- •Key Responsibilities Build and maintain benchmarks and evaluations for Engine agents.
- •Design and run experiments to improve agent performance.
- •Explore and implement post-training and fine-tuning techniques.
- •Turn successful experiments into production improvements.
- •Help define the ML roadmap and technical direction for Engine agents.
- •Requirements 4+ years of experience in ML/AI research or a related field.
- •Master's or Ph.D. in a relevant scientific field.
- •Hands-on experience working with LLMs and AI agents.
- •Strong experience designing benchmarks, evaluations, and experiments for AI/ML systems.
- •Strong software engineering skills, with a track record of taking ideas from research prototype to production impact.
Required skills
LangChainLLMsPython
Domain expertise
developer-toolsaiproductivity
Benefits & perks
Medical coverage, Dental coverage, Vision coverage, Flexible vacation, 401(k) plan, Life insurance
Tech stack
PythonLangChainLLMsAWSGoogle CloudAzureDockerKubernetesCI/CDGit