About the role
TL;DR
Develop and refine multimodal video analysis systems for video intelligence workflows.
- •Join TwelveLabs as a Senior ML Research Scientist to develop cutting-edge multimodal foundation models for video understanding.
- •You will work on Pegasus, our core video understanding product, and contribute to building customer-facing video intelligence workflows.
- •Key Responsibilities Develop and refine multimodal video analysis systems.
- •Collaborate with cross-functional teams to ship products with real-world value.
- •Implement time-based metadata capabilities for video analysis.
- •Ensure production-grade reliability and temporal understanding in video intelligence workflows.
- •Contribute to the development of Segment, our time-based metadata capability.
- •Requirements PhD or Master's in Computer Science, AI, or related field.
- •Extensive experience in machine learning and deep learning.
- •Strong background in computer vision and natural language processing.
- •Proficiency in TensorFlow, PyTorch, and scikit-learn.
- •Experience with video analysis and multimodal data processing.
Required skills
TensorFlowPyTorchscikit-learnComputer VisionNLPLLMsKubeflowSageMakerVertex AIONNXJAXREST APIgRPCKubernetesDocker
Nice-to-have skills
Hugging FaceMLflowGitLinuxJiraConfluenceFigmaPostmanSwaggerWebSockets
Domain expertise
ai
Tech stack
TensorFlowPyTorchscikit-learnOpenAPIREST APIgRPCKubernetesAWSGoogle CloudTerraformCI/CDDockerElasticsearchMongoDBPostgreSQLRedisPythonJavaScriptReactNext.jsTypeScriptNode.jsExpressHugging FaceComputer VisionNLPLLMsMLflowKubeflowSageMaker