Data Engineering - Senior / Lead Engineer

Data Engineering Lead Engineer to build and scale data platforms with Hadoop and Spark.

• •This position requires someone to work on complex technical projects and closely work with peers in an innovative and fast-paced environment.
• •For this role, we require someone with a strong product design sense & specialized in Hadoop and Spark technologies.
• •Key Responsibilities Grow analytics capabilities with faster, more reliable tools, handling petabytes of data every day.
• •Brainstorm and create new platforms for low latency and horizontal scalability.
• •Design and develop a real-time events pipeline for Data ingestion for real-time dashboarding.
• •Develop complex and efficient functions to transform raw data sources into reliable components of our data lake.
• •Design & implement new components and various emerging technologies in Hadoop Eco-System.
• •Requirements 4 to 8 years of experience in Big Data technologies.
• •Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc.
• •Excellent programming/debugging skills in Python/Java/Scala.