C
Sr. Data Platform Engineer
Craft Machine IncSupply Chain company
United StatesSenior
Greycroft
Uncork Capital
High Alpha
Glasswing Ventures
London Co-Investment Fund
Data & AI
About the role
TL;DR
Build and optimize data pipelines, analyze datasets, and design maintainable software.
- •As a core member of the team, you will have great say in how solutions are engineered and delivered.
- •Craft gives engineers a lot of responsibility and authority, which is matched by our investment in their growth and development.
- •Key Responsibilities Build and optimize data pipelines (batch and streaming).
- •Extracting, analyzing and modeling rich and diverse datasets of structured and unstructured data.
- •Design software that is easily testable and maintainable.
- •Keep track of emerging technologies and trends in the Data Engineering world, incorporating modern tooling and best practices at Craft.
- •Apply machine learning techniques such as anomaly detection, clustering, regression classification, and summarization to extract value from our data sets.
- •Requirements 4+ years of experience in Data Engineering. 4+ years of experience with Python.
- •Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance, and observability of data pipelines in a production environment.
- •Strong knowledge of SDLC and solid software engineering practices.
- •Familiarity with at least some of the technologies in our current tech stack: Python, PySpark, Pandas, SQL (PostgreSQL), ElasticSearch, Airflow, Docker, Databricks, AWS, CircleCI, GitHub, Terraform.
Required skills
PythonPandasSQLAirflowDockerDatabricksAWSElasticsearchTerraform
Nice-to-have skills
CircleCI
Benefits & perks
Competitive salary, Equity, Unlimited vacation, Health insurance, 401K
Tech stack
PythonSparkPandasSQLElasticsearchAirflowDockerDatabricksAWSCircleCITerraform