Senior Data Engineer, Big Data and Cloud
Vistar MediaProgrammatic Digital company
New York, United States$105,100 - $189,600Senior
Advancit Capital
Basset Investment Group
Ben Franklin Technology Partners of Southeastern Pennsylvania
Capital Southwest
Lamar Advertising Company
Francisco Partners
Data & AI
About the role
TL;DR
Design and develop scalable big data pipelines and ETL processes using Python, Spark, and cloud technologies.
- •Vistar Media, now part of T-Mobile Advertising Solutions, is seeking a Senior Data Engineer to build privacy-first advertising and data products using advanced machine learning, large-scale data processing, and cloud technologies.
- •Key Responsibilities Design and develop data engineering solutions for data pipelines, visualization, and analytical tools.
- •Innovate, implement, and iterate on scalable big data pipelines and ETL processes.
- •Write robust, efficient, and highly maintainable code in Python, Spark, and Scala.
- •Contribute to team knowledge sharing and drive the advancement of new data engineering capabilities.
- •Assist leaders in project definition, estimation, planning, and scoping.
- •Requirements Bachelor's Degree plus 5 years of related work experience OR Advanced degree with 3 years of related experience. 4-7 years of hands-on implementation and architectural familiarity with streaming data, relational/non-relational databases, and distributed processing technologies. 4-7 years designing and developing advanced data engineering tasks in Python, SQL, Spark, and related Python libraries. 4-7 years advanced knowledge in building complex data pipelines and cloud-based services (GCP) using Airflow and Kafka.
Required skills
PythonSparkScalaSQLGoogle CloudAirflowPandasNumPyscikit-learnBigQuery
Domain expertise
adtechmedia
Tech stack
PythonSparkScalaSQLGoogle CloudAirflowBigQueryPandasNumPyscikit-learn
