ML Engineer (Data Engine)
HiggsfieldGenerative AI company
Almaty, KazakhstanMid
Accel
Menlo Ventures
GFT Ventures
AI Capital Partners
BroadLight Capital
NextEquity Partners
Data & AINew
About the role
TL;DR
ML Engineer to analyze video dynamics and train AI models for generative AI video creation.
- •Higgsfield AI is a rapidly growing generative AI company building AI-powered video creation tools.
- •This role focuses on analyzing motion and physical dynamics in video to train models for creative applications.
- •Key Responsibilities Analyze motion and physical dynamics in video, including optical flow, camera vs. object motion, and physical plausibility.
- •Train models for post-training, including reward models, and build video classifiers for motion types, genres, and quality.
- •Develop methods for creating multi-shot video sequences and work with audio processing, including speech/music detection and audio-visual synchronization.
- •Build and run large-scale distributed processing pipelines for video and audio data.
- •Requirements Strong PyTorch skills and hands-on model training experience, including fine-tuning and deploying classifiers, embedding models, and VLMs.
- •Deep knowledge of video-processing methods, including motion analysis and temporal consistency evaluation.
- •Experience building and validating classifiers on video data, including annotation workflows and active learning.
- •Strong understanding of data-curation techniques and experience processing large-scale unstructured datasets, particularly video and audio.
Required skills
PythonPyTorchComputer VisionNLPLLMs
Nice-to-have skills
AWSGoogle CloudAzureDockerKubernetesGit
Domain expertise
aimedia
Benefits & perks
Competitive base salary in USD, Equity participation, Relocation support to Almaty, Company-provided equipment, meals, transportation, or other office benefits
Tech stack
PythonPyTorchComputer VisionNLPLLMsAWSGoogle CloudAzureDockerKubernetesGit
