Senior Data Engineer
IDTPayments company
Pune, IndiaSenior
BlackRock, Inc.
State Street Global Advisors, Inc.
Cooke & Bieler, L.P.
Data & AI
About the role
TL;DR
Design and maintain data pipelines and architectures for IDT's BI team.
- •Join IDT's BI team as a Senior Data Engineer with AI/ML experience to design and maintain data pipelines and architectures.
- •Key Responsibilities Design, develop, and maintain scalable data pipelines.
- •Optimize ETL/ELT pipelines and data structures.
- •Build workflows for extracting and storing unstructured data.
- •Requirements Senior Data Engineer with 6-7+ years of experience.
- •Hands-on experience with big data technologies.
- •Demonstrated skills in SQL and PLSQL programming.
Required skills
PythonSQLSparkSnowflake
Nice-to-have skills
Apache KafkaLangChainHugging FaceLLMs
Domain expertise
fintech
Benefits & perks
Remote work opportunity, Competitive salary, Continuous learning and career growth opportunities, Compensation for professional training, seminars, and conferences, Referral program
Tech stack
PythonSQLSparkApache KafkaSnowflakeRedshiftAirflowLangChainHugging FaceLLMsAWS