M
Engineering Manager – AI Engineering
MeeshoOnline Marketplace company
Bangalore, IndiaManager
Tiger Global Management
Elevation Capital
Peak XV Partners
SoftBank
Prosus Ventures
Meta
Data & AI
About the role
TL;DR
Lead AI engineering teams to develop and scale AI platforms and infrastructure.
- •We are looking for an experienced Engineering Manager
- •AI Engineering to lead the development of scalable AI platforms and infrastructure while managing high-performing engineering teams.
- •You will drive the design, delivery, and optimization of production-grade AI systems powering AI use cases across Meesho.
- •Key Responsibilities Lead, mentor, and grow a team of AI engineers
- •setting technical direction, raising the engineering bar, and owning execution and delivery end to end.
- •Architect and scale Meesho's AI platform: cross-region model inference, multi-GPU fleet allocation and management, distributed training, and feature-engineering infrastructure.
- •Drive inference optimization across the full stack
- •GPU kernel tuning, quantization, and memory/IO-bandwidth optimization.
- •Optimize open-weight models at both the model and inference-engine level.
- •Scale data-science productivity through autonomous, agent-driven workflows.
- •Requirements 9+ years of software engineering experience, including 2+ years managing engineers.
- •Strong hands-on experience with the modern LLM inference stack
- •TensorRT-LLM, vLLM, SGLang
- •and with production, low-latency model serving at scale.
- •Depth in inference optimization: GPU kernel tuning, quantization, speculative decoding, KV-cache and memory/IO optimization.
- •Experience with distributed training and the frameworks behind it
- •PyTorch FSDP, DeepSpeed, Megatron, or Ray.
- •Experience running GPU fleets in production
- •Kubernetes (ideally GKE), GPU scheduling and allocation.
Required skills
PythonKubernetesPyTorchGKEC++GoRust
Nice-to-have skills
Spark
Domain expertise
ecommerce
Tech stack
PythonPyTorchKubernetesGKESparkC++GoRust