Senior Software Engineer, AI
KlueCompetitive Intelligence company
Toronto, CanadaSenior
Tiger Global Management
Salesforce Ventures
OMERS
BDC
Data & AI
About the role
TL;DR
Senior Software Engineer to build and optimize LLM-powered agents for competitive intelligence.
- •Klue is seeking a Senior Software Engineer to join their Toronto team, focusing on building and optimizing LLM-powered agents for competitive intelligence.
- •You will lead the design and development of agent systems that enable users to generate competitive insights.
- •Key Responsibilities Build and ship backend systems powering agentic workflows, including retrieval pipelines and orchestration layers.
- •Own the evaluation of agentic systems at scale, developing and operating evaluation frameworks.
- •Design and optimize retrieval and ranking systems, understanding hybrid retrieval and dense retrieval approaches.
- •Improve LLM-powered workflows end-to-end, focusing on prompt design, caching, and latency optimization.
- •Collaborate with product, infrastructure, and data teams to align technical direction with product goals.
- •Requirements Experience building and operating backend systems in production, with expertise in search/retrieval, data pipelines, or distributed systems.
- •Hands-on experience with search, retrieval, or ranking systems, including information retrieval fundamentals.
- •Experience building or evaluating agentic/LLM-powered systems, including retrieval-augmented generation.
- •Strong software engineering fundamentals with proficiency in Python and backend frameworks.
- •Familiarity with vector databases and search infrastructure (e.g., FAISS, Pinecone, Elasticsearch).
Required skills
PythonLLMsNLPDockerKubernetesGoogle CloudCI/CD
Nice-to-have skills
PyTorchElasticsearchPostgreSQLLangChain
Domain expertise
aiproductivity
Benefits & perks
Extended health & dental coverage, Employee Stock Option Plan, Mac/PC, Dog-friendly offices
Tech stack
OpenAI APIAnthropic APIPyTorchElasticsearchPostgreSQLMLflowDockerKubernetesGoogle CloudPythonGitCI/CD
