About the role
Build and optimize scalable data pipelines at Alembic.
- •As a Senior Data Engineer at Alembic, you will be at the core of our data platform, building scalable and reliable data pipelines, optimizing storage solutions, and enabling real-time and batch analytics.
- •Key Responsibilities Design, develop, and maintain scalable ETL pipelines that ingest, process, and transform large volumes of structured and unstructured data.
- •Optimize data storage solutions using modern data lakehouse architectures and best practices for cost, performance, and reliability.
- •Collaborate with data scientists and engineers to integrate machine learning models and analytical workloads into production environments.
- •Ensure data integrity, quality, and security by implementing monitoring, alerting, and governance best practices.
- •Work with cloud-based data warehouses and distributed data processing frameworks.
- •Continuously evaluate and implement new technologies to improve data infrastructure and operational efficiency.
- •Requirements 10+ years of experience in data engineering, software engineering, or a related field.
- •Strong expertise in SQL and Python for data processing.
- •Experience with modern data warehousing and lakehouse solutions (i.e.
Tech stack
SQLPythonSparkApache KafkaAWSGoogle CloudAzureDockerKubernetesTerraformCloudFormation
Match insights
Tech:SQL, Python, Spark, Apache Kafka, AWS
Level:Senior