Design and build large-scale data pipelines and foundational data sets.
•As a Senior Data Engineer at Metropolis, you will play a key role in shaping data products that align with our mission.
•Your technical expertise and analytical acumen will contribute to designing and building extensive data sets that impact thousands of internal users and millions of members.
•Key Responsibilities Collaborate with cross-functional teams to develop end-to-end data pipelines and foundational data sets Design and own data architecture for large-scale projects while managing operational trade-offs Build and optimize sophisticated data pipelines, models, and visualizations across multiple domains Define and manage Service Level Agreements (SLAs) for all owned data sets Implement data security models, ensure privacy compliance, and evolve data governance processes Requirements Bachelor's degree in Computer Science, Computer Engineering, or a relevant technical field 5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools, working with large data sets in the cloud 5+ years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in Snowflake and dbt Experience with cloud computing services, preferably AWS, including hands-on experience with services like Glue, Airflow (MWAA), DMS, EKS, and SNS