Lead Software Engineer - Data

Job Description

SUMMARY

Hulu's Identity Management Team is seeking a Lead Software Engineer who will be an exceptional addition to our engineering team. As a Lead Software Developer at Hulu, you will be the expert of big data and work with all facets of Hulu including the product, user experience, design and program management teams to build out the right services and tools. Your primary responsibility is establishing Identity data lake, developing data pipeline (ETL) for online data analysis and identity team's ML model for suspicious detection, anomaly detection and account sharing detection, and also a key driver of data driven development to guide the online service and feature development. The right person for this role is a passionate technology pioneer, a practical programmer and an inquisitive explorer - a person who can envision the technologies we need tomorrow and define the path to get there from today. If you are someone who thrives in a team environment and gains personal satisfaction when sharing knowledge and partnering with teams across Hulu, then this is the perfect role for you.

WHAT YOU'LL DO （Job description）
• Architect, design, and implement the data lake of identity to achieve the requirements of offline/near-line and real-time analysis.
• Lead to build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
• Identify weaknesses and gaps in the current architecture and drive resolutions across the Hulu technology organization
• Establish and drive engineering best practices around agile and quality-focused development with a focus on security
• Collaborate with program managers, product managers, SDET, and researchers in an open and innovative environment
• Recruit, hire, and mentor junior developers

WHAT TO BRING （Requirements）
• BS, MS, PHD degree in CS related major
• 6+ years working experience on software development, 4+ years of big data design experience with technical stacks like Spark, Flink, Druid, Clickhouse, Single Store, Snowflake, Kafka, Nifi and AWS big data technologies
• Experience with processing large amount of data at petabyte level
• Proven track record with cloud infrastructure technologies, at least two of Terraform, K8S, Spinnaker, IAM, ALB, and etc.
• Expert knowledge in at least one internet-class development language: Java, Scala, Python
• Independent, energetic, highly technical, and thrives under pressure and ambiguity
• Excellent communication and collaboration skill in English and Mandarin Chinese

NICE-TO-HAVES
• The experience to build the Identity Graph.
• Experience with feature store, audience segmentation and BI
• Experience with the products of Databricks, AWS EMR, Impala, Presto, Redshift etc

Jobcode: Reference SBJ-gx6e5z-18-189-170-17-42 in your application.