AI Data Engineer
FluencyProcess Automation company
San Francisco, United States$150K - $250KSenior
Data & AI
About the role
Design and build data systems for enterprise intelligence.
- •Design and build data systems for enterprise intelligence.
- •Key Responsibilities Design ingestion pipelines for millions of events daily.
- •Build data validation and quality systems.
- •Create feature stores and serving infrastructure.
- •Optimise storage and query patterns for time-series data.
- •Orchestrate complex DAGs for OCR, LLM enrichment, and aggregations.
- •Requirements Strong Python fundamentals and software engineering discipline.
- •Experience with data pipelines (Dagster, Airflow, Prefect).
- •Data modelling expertise for analytical and ML workloads.
- •Infrastructure experience with AWS, containerisation, IaC.
Tech stack
PythonAirflowdbtPostgreSQLAWSS3RDSNeo4jDatadogDockerKubernetesCI/CDGitLinux
Match insights
Tech:Python, Airflow, dbt, PostgreSQL, AWS
Level:Senior