Staff Data Engineer
TruecallerCaller ID company
Bangalore, IndiaLead
Sequoia Capital
Atomico
OpenOcean
Kleiner Perkins Caufield & Byers
Peak XV Partners
Data & AI
About the role
TL;DR
Lead the design and implementation of high-scale data pipelines and infrastructure to support global product analytics and AI.
- •As a Staff Data Engineer, you will lead the development of scalable data pipelines and frameworks to support product decisions and user understanding.
- •You will drive architectural vision for high-throughput systems and empower teams with a self-serve analytics platform.
- •Key Responsibilities Lead the architectural design and implementation of high-throughput, low-latency data pipelines using Spark and Kafka.
- •Develop and optimize robust data models in BigQuery and orchestrate complex workflows using Apache Airflow.
- •Partner with Data Science teams to operationalize AI/ML models for real-time production environments.
- •Mentor engineering teams and champion high standards for code quality and system reliability.
- •Requirements Exceptional proficiency in Python or Scala for building highly optimized data systems.
- •Extensive architectural experience with distributed systems like Apache Spark and Kafka.
- •Proven ability to lead complex, cross-functional initiatives and translate ambiguous requirements into technical roadmaps.
Required skills
PythonScalaSparkApache Kafka
Nice-to-have skills
FlinkKinesisGoogle CloudBigQueryAirflow
Domain expertise
adtech
Tech stack
PythonScalaSparkApache KafkaBigQueryAirflowFlinkKinesisGoogle Cloud
