About the role
Contract role on EarnIn's Gen AI Team focusing on evaluation-driven development for LLM-powered chatbots.
- •Contract role on EarnIn's Gen AI Team in Bengaluru focusing on evaluation-driven development for LLM-powered chatbots, July 2026–Feb 2027, two days/week onsite.
- •Key Responsibilities Build and run evaluations for LLM chatbot systems Design and calibrate LLM-as-judge scorers with SMEs Contribute to conversation simulation and replay infrastructure Support real-time observability tooling and analyze production conversations Requirements Actively pursuing a degree in CS, Math, Physics, or engineering Familiarity with Python and working with APIs/data pipelines Curiosity about LLMs, AI evaluation, and NLP concepts Strong analytical and communication skills
Tech stack
PythonLLMsNLP
Match insights
Tech:Python, LLMs, NLP
Level:Mid