C
About the role
TL;DR
Data Engineer responsible for data model integrity, pipelines, and cloud deployments.
- •CI&T is seeking a Data Engineer to ensure the integrity, consistency, and efficiency of data models across the ecosystem.
- •This role involves structural reviews, defining standards, and ensuring governance.
- •Key Responsibilities Develop and maintain data pipelines (ETL/ELT) in Azure using Databricks.
- •Perform data queries, integrations, and manipulations in relational and non-relational environments (SQL, MongoDB).
- •Implement CI/CD practices for deployment automation and code versioning with GitHub.
- •Design and optimize data models for scalability, performance, and governance.
- •Collaborate with business and data science teams for AI model deployment in the cloud.
- •Requirements Solid experience in Azure Data Services and Databricks.
- •Experience with Databricks and PySpark.
- •Proficiency in Python and SQL for data manipulation and transformation.
- •Knowledge of CI/CD and versioning with GitHub.
- •Experience in data modeling (conceptual, logical, and physical).
Required skills
PythonSQLAzureDatabricksSparkCI/CD
Nice-to-have skills
MongoDBPower BI
Tech stack
PythonSQLAzureDatabricksSparkMongoDBCI/CDPower BI