About the role
TL;DR
Build and scale systems for processing large-scale video and multimodal data for model training.
- •Cantina Labs is a social AI company building real-time models to bring characters to life.
- •We are looking for an ML Engineer to join our growing Singapore team to build and scale systems for processing large-scale video and multimodal data for model training.
- •Key Responsibilities Design and scale distributed data pipelines for preprocessing and dataset generation.
- •Own workflow orchestration, job scheduling, monitoring, and failure recovery.
- •Implement and maintain containerized pipeline infrastructure using Kubernetes.
- •Optimize cloud-based data storage and movement for cost and efficiency.
- •Design and implement curation pipelines for video and image datasets.
- •Requirements Strong experience building large-scale data systems and pipelines for ML.
- •Experience with distributed data processing frameworks (PySpark or Ray) and orchestration tools (Airflow).
- •Familiarity with containerization and orchestration (Docker, Kubernetes).
- •Experience with cloud-based data storage and compute (AWS, GCS, Azure).
- •Proficiency in Python.
Required skills
PythonSparkAirflowDockerKubernetesAWSGoogle CloudAzure
Nice-to-have skills
PyTorch
Domain expertise
ai
Benefits & perks
Competitive salary and generous company equity, Personal time off and paid holidays, Health insurance, Global travel insurance, Monthly spending stipend: $500 (~S$635), Equipment: All equipment needed for your home office
Tech stack
PythonSparkAirflowDockerKubernetesAWSGoogle CloudAzurePyTorch