This role is no longer accepting applications via Rocketlist.
Quality Analyst II
HighLevelMarketing Automation company
United StatesMid
General Atlantic
PeakEquity Partners
Data & AI
About the role
TL;DR
Evaluate and improve AI-powered workflows for customer success.
- •Evaluate AI quality across the advisor stack and iterate inside ORA.
- •Key Responsibilities Evaluate AI output across the full call lifecycle.
- •Refine and iterate on prompts within existing skills and sub-agents.
- •Tag conversations by product area, severity and issue type.
- •Stay current on LLM behavior, prompt patterns and AI evaluation techniques.
- •Share what you learn with the broader Success team and the Lead Analyst.
- •Requirements Insatiable curiosity and a self-learning mindset. 2+ years of experience in Quality Assurance, Customer Support, AI evaluation or a related role.
- •Working understanding of how LLMs behave.
- •Comfort reading code and making minor edits.
- •Strong written communication and attention to detail.
Required skills
LLMsSQL
Domain expertise
ai
Tech stack
LLMsSQL