Senior Software Development Test Engineer
TekionAutomotive Retail company
Bangalore, IndiaSenior
Dragoneer Investment Group
Index Ventures
Alkeon Capital
Durable Capital
Hyundai Motor Company
Advent International
Software EngineeringNew
About the role
TL;DR
Senior SDET to build automated testing for AI products, focusing on LLMs and data quality.
- •Tekion is seeking a Senior Software Development Test Engineer to build automated testing suites for AI-powered products, focusing on generative AI, LLMs, and data quality assurance.
- •This role involves ensuring the reliability and performance of cutting-edge AI platforms.
- •Key Responsibilities Build automated testing suites for LLM-powered products to detect hallucinations, bias, and vulnerabilities.
- •Implement automated evaluations for RAG systems and validate multi-agent workflows.
- •Statistically validate AI data outputs and programmatically audit data pipelines.
- •Maintain automated suites tracking ML metrics and implement continuous monitoring for data drift.
- •Embed AI evaluation suites into MLOps and CI/CD pipelines to automatically block releases on quality failures.
- •Requirements 5+ years of experience in an SDET role.
- •Expert-level Python for test automation, eval pipelines, and data analysis.
- •Experience with LLM evaluation frameworks (RAGAS, DeepEval, etc.) and agent workflow testing (LangChain).
- •Familiarity with MLOps and CI/CD tools (MLflow, Docker, GitHub Actions).
- •Experience with API testing frameworks (Pytest, Postman).
Required skills
PythonSQLPytestDockerGitHub ActionsJenkinsPostmanOpenAI APILangChainPandasNumPyMLflow
Nice-to-have skills
AWSKubeflowTerraformPlaywrightCypressLocustscikit-learn
Domain expertise
aiautomotive
Benefits & perks
Opportunity to work with some of the smartest minds to solve complex challenges at scale., Impactful role in shaping and securing a global, cloud-native & AI driven platform., Innovative, collaborative, and fast-paced culture
Tech stack
PythonSQLLangChainOpenAI APIAnthropic APIHugging FacePandasNumPyPytestPostmanMLflowDockerGitHub ActionsJenkinsGrafanaAWSKubeflowscikit-learnTensorFlowPyTorchKubernetesTerraformPlaywrightCypressLocust