Job Description
Netflix is enjoyed by more than 200 million members globally, entertaining new audiences every day. Netflix's cloud platform is crucial in making the experience great. We are one of the pioneers of leveraging a highly scalable distributed cloud footprint to deliver delightful experiences to our members worldwide.
The Security and Platform Data Engineering team builds data products that enable the architecting of secure, reliable, scalable, and efficient platforms. We partner with our security and platform engineering teams to empower them with data for more intelligent decision-making and innovative solutions to challenging problems.
This role is specifically focused on enabling our cloud platforms to scale effectively and efficiently. Our data products enable engineering teams that build and manage our compute platform, our custom big data platform, productivity tools, network architecture, capacity and demand planning.
We are looking for a Senior Data Engineer to build reliable data pipelines and intuitive data products that allow our stakeholders to efficiently leverage data in an effective manner. As part of this team, you will work on diverse data technologies such as Spark, Presto, Flink, Kafka, and others to build insightful, scalable, and robust data pipelines; write ETL jobs to collect and aggregate data; and build high-quality data models that describe the entities, interactions and usage of Netflix' cloud infrastructure.
The ideal candidate will have a strong background in distributed data processing, have great and demonstrable data intuition, and share our passion for continuously improving the ways we use data to make the Netflix infrastructure better.
Who you are:
• Passionate about building intuitive data models and an expert in distributed data processing patterns
• Highly proficient in at least one of Java, Python, or Scala with at least 10 years of software/data engineering experience
• Comfortable with complex SQL
• Expert in engineering data pipelines using big data technologies (Hive, Presto, Spark, Flink) on large-scale data sets demonstrated through years of experience
• Conceptually familiar with AWS cloud resources (S3, EC2, RDS etc)
• Excel at taking vague requirements and crystallizing them into scalable data solutions
• Excited about operating independently, demonstrating excellence, and learning new technologies and frameworks
What you will do:
• Engineer efficient, adaptable, and scalable data pipelines to process structured and unstructured data
• Develop subject-matter expertise in the cloud infrastructure domain at Netflix
• Act as a thought partner to the platform engineering team, understand their challenges, and make opinionated recommendations that empower them with data solutions to scale Netflix infrastructure and tools efficiently.
• Maintain and rethink existing datasets and pipelines to service a wider variety of use cases
• Enable intelligent analytics by building robust, reliable, and valuable data sets that can power various analytic techniques like regression, classification, clustering, etc
• Join a stunning team of data engineers with diverse skill sets, partnering closely with analytics engineering and data science counterparts
A few more things to know:
Our culture is unique and We regularly share examples of our work on our tech blog. You will need to be comfortable working in the most agile of environments. Requirements will be vague. Iterations will be rapid. You will need to be nimble and take smart risks.
Jobcode: Reference SBJ-r1zxpv-34-206-1-144-42 in your application.