Software Engineer, Lakehouse (Data Platform Group)
Cato NetworksSASE company
Tel Aviv, IsraelSenior
Lightspeed Venture Partners
Acrew Capital
Greylock Partners
Vitruvian Partners
ION Crossover Partners
Adams Street Partners
Data & AI
About the role
TL;DR
Build and own a petabyte-scale data platform processing 1M records/sec.
- •Cato Networks is seeking an experienced Software Engineer to join their Data Platform Group.
- •This role involves building a cutting-edge data platform that processes a massive volume of data at low latency, impacting customers and enabling various internal teams.
- •Key Responsibilities End-to-end ownership of the large-scale analytical storage layer.
- •Design and develop the batch processing layer using Spark on EMR.
- •Build and evolve Java/Spring Boot services exposing data through APIs.
- •Optimize performance and cost of the data platform.
- •Research and adapt new lakehouse technologies.
- •Requirements 5+ years of experience in large-scale distributed data systems.
- •Deep expertise in Spark, columnar databases (ClickHouse is a plus), or open table formats.
- •Strong Java and object-oriented design skills.
- •Experience building microservices on Kubernetes and using AWS services (EMR, S3, Glue).
Required skills
JavaSparkPythonKubernetesAWSSQL
Nice-to-have skills
Athena
Domain expertise
cybersecuritytelecom
Tech stack
JavaSparkPythonKubernetesAWSS3SQL