Software Engineer, Data & AI Platform
CorteaAuditTech company
Berlin, GermanySenior
Dawn Capital
Cherry Ventures
Atomico
Mosaic Ventures
Discovery Ventures
Data & AI
About the role
TL;DR
Builds data, evaluation, and observability for production-grade LLM agents.
- •Cortea is a Berlin startup transforming audits with AI.
- •We are looking for an Engineer with strong data engineering and AI systems experience to build the data, evaluation, and observability foundation for production-grade LLM agents.
- •This role sits at the intersection of backend engineering, data engineering, AI infrastructure, and LLM operations.
- •Key Responsibilities Building online and offline evaluation systems for LLM agents.
- •Creating automated quality gates for changes to prompts, context, models, or agent logic.
- •Analyzing large volumes of agent traces and executions to identify failure modes and optimization opportunities.
- •Working with columnar data stores and analytical databases.
- •Creating observability tooling for trace analysis and debugging.
- •Requirements Strong Python and/or backend engineering experience.
- •Strong SQL skills and comfort working with large datasets.
- •Experience deploying and operating systems in the cloud, ideally on GCP.
- •Practical experience designing data pipelines, ETL/ELT workflows, or event-processing systems.
- •Understanding of system design, reliability, observability, and monitoring.
Required skills
PythonSQLGoogle CloudBigQueryLLMs
Nice-to-have skills
LangChain
Domain expertise
aiproductivity
Benefits & perks
Equity, Learning budget, Flexible vacation, Team lunches, Retreats
Tech stack
PythonSQLGoogle CloudBigQueryLLMsGit
