Machine Learning Engineer, Core Evaluations
CantinaDigital Transformation company
Europe€170K - €190KSenior
Data & AI
About the role
TL;DR
Design and develop model evaluation pipelines for audio models.
- •We are seeking an experienced Machine Learning Engineer to focus on audio model evaluation for speech generation and recognition models.
- •Key Responsibilities Designing model evaluation pipelines for models in development and production Designing user studies for subjective model evaluations Converting requirements into measurable metrics Designing and developing automated evaluation dashboard to see model performances and compare results Training new models to capture new and different evaluation metrics Requirements Strong experience and intuition for designing metrics that capture model performance Strong experience with designing user studies on Mechanical Turk or similar platforms Strong experience with model training and fine-tuning for model evaluation Strong statistical knowledge and experience to statistically compare evaluation results and take decisions Very strong engineering and programming skills Experience with training ASR, TTS models Experience at ML teams working on large-scale machine learning problems (>3B models with >1m hours of data)
Required skills
PythonTensorFlowscikit-learnPandasNumPyCI/CDKubernetesAWSGoogle CloudAirflowDatabricksApache KafkaPostgreSQLMySQLMongoDB
Domain expertise
ai
Benefits & perks
Competitive salary, Generous company equity, Medical, dental, and vision insurance, Paid time off, Parental leave, 401(k) retirement savings plan, Lifestyle spending account, Complimentary lunch and snacks, One Medical membership
Tech stack
PythonTensorFlowscikit-learnPandasNumPyCI/CDKubernetesAWSGoogle CloudAirflowDatabricksApache KafkaPostgreSQLMySQLMongoDBRedisElasticsearchDynamoDBSQLGitLinuxJiraConfluenceFigmaPostmanREST APIgRPCWebSocketsRabbitMQCelery