Sr. Software Development Engineer in Test (Agentic)
DialpadBusiness Communications company
Vancouver, Canada$150,500 - $175,250 CADSenior
GV
Andreessen Horowitz
Iconiq Capital
Software EngineeringNew
About the role
TL;DR
Own test automation and quality frameworks for Dialpad's AI Voice Agent services.
- •SDET in Agentic QA, you will own the test automation and quality frameworks that support Dialpad's AI Voice Agent services.
- •You will develop automated tests for end-to-end product experiences, from frontend UI to backend services to APIs to audio/text interactions.
- •Key Responsibilities Own end-to-end quality for agentic features and workflows.
- •Design and build automation tooling and frameworks for AI/LLM-driven systems.
- •Develop and maintain evaluation frameworks to measure response quality, accuracy, and hallucination rates.
- •Drive automation coverage using deterministic + probabilistic validation approaches.
- •Integrate AI quality checks into CI/CD pipelines with fast feedback cycles.
- •Requirements 6+ years of experience in software engineering or SDET roles with an emphasis on software development.
- •Strong programming skills in Python (preferred), Java, or JavaScript.
- •Hands-on exposure to LLMs or AI/ML systems.
- •Experience building test frameworks and scalable automation systems.
- •Familiarity with AI evaluation techniques.
Required skills
PythonCI/CDLLMsJavaScriptJavaGitHub ActionsJenkinsREST APIWebSockets
Nice-to-have skills
LangChainOpenAI APIAnthropic APIGemini API
Domain expertise
aitelecomproductivity
Benefits & perks
Comprehensive benefits, Equity, Bonus
Tech stack
PythonJavaJavaScriptVue.jsReactGoogle CloudCloud RunKubernetesRedisElasticsearchNode.jsLLMsOpenAI APIAnthropic APIGemini APILangChainCI/CDGitHub ActionsJenkinsGitLinuxPostmanREST APIWebSockets