Senior Applied AI Evaluation Engineer - RAN Ticket Intelligence
Parallel WirelessOpenRAN Telecommunications company
Kfar SabaSenior
DN Capital
EchoVC Partners
Highland Capital Partners
Pine Creek Capital
First Star Ventures
Data & AI
About the role
TL;DR
Evaluate and improve AI systems for analyzing engineering tickets and supporting root-cause analysis.
- •Parallel Wireless is seeking a Senior Applied AI Evaluation Engineer to enhance their RAN R&D organization's analysis of engineering tickets, root-cause analysis, and ownership recommendations.
- •This role focuses on evidence-based improvements in AI-driven ticket intelligence.
- •Key Responsibilities Define AI use cases, acceptance criteria, and evaluation metrics for RAN ticket intelligence.
- •Build and maintain evaluation datasets from resolved tickets and related engineering data.
- •Establish baselines and evaluate AI approaches (LLM, RAG, search, agents) against them.
- •Analyze failures and prototype improvements in AI systems.
- •Develop reusable evaluation pipelines and tools.
- •Requirements BSc or MSc in a relevant field or equivalent experience. 5+ years of hands-on experience in applied ML, data science, NLP, or AI systems.
- •Recent experience evaluating LLM, RAG, search, or agent systems.
- •Strong Python and SQL skills for data pipelines and tools.
- •Practical experience with information retrieval, embeddings, or LLM failure modes.
Required skills
PythonSQLLLMsNLP
Nice-to-have skills
LangChainOpenAI APIGit
Domain expertise
telecom
Tech stack
PythonSQLLLMsOpenAI APILangChainGit