Data Warehouse Software Engineer III
Babel StreetRisk Intelligence company
Somerville, United States$120,000 - $135,000 USDSenior
Data & AI
About the role
TL;DR
Data Warehouse Software Engineer III to optimize GCP data warehousing and ingestion ecosystem.
- •Babel Street is seeking an experienced Data Warehouse Software Engineer III to own, scale, and optimize their core Google Cloud Platform (GCP) data warehousing and ingestion ecosystem.
- •This role involves architecting high-volume data ingestion pipelines, orchestrating complex workflows, and maintaining the performance and reliability of their enterprise data warehouse.
- •Key Responsibilities Architect, build, and maintain production-grade ELT/ETL data pipelines into Google BigQuery.
- •Manage, monitor, and upgrade Apache Airflow / Cloud Composer platform.
- •Maintain and optimize core GCP data services (BigQuery, Cloud Storage, Cloud Functions/Run, Pub/Sub, IAM).
- •Develop high-performance Python scripts and API connectors for data integration.
- •Enforce data quality frameworks and implement automated alerting.
- •Requirements 4–7+ years of professional software development experience, with 3+ years focused on data warehousing and cloud data pipelines.
- •Advanced Python development skills for data processing and integrations.
- •Hands-on experience with Apache Airflow (Cloud Composer preferred).
- •Deep experience with GCP analytics suite (BigQuery, Cloud Storage, Cloud Composer, Pub/Sub, Cloud Functions/Run).
- •Proficient with Git, CI/CD pipelines.
Required skills
PythonGoogle CloudBigQueryAirflowIAMGitCI/CD
Domain expertise
defensegovernment
Benefits & perks
Health Benefits, Retirement Plans, Unlimited Flexible Leave, Holidays, Tuition Reimbursement
Tech stack
PythonGoogle CloudBigQueryAirflowCloud RunIAMGitCI/CD