Lead Data Engineer

Job Description

Disney Entertainment & ESPN Technology
On any given day at Disney Entertainment & ESPN Technology, we are reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that is evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you would love working for Disney Entertainment & ESPN Technology
• Building the future of Disney's media business: DE&E (Disney Entertainment & ESPN) Technologists are designing and building the infrastructure that will power Disney's media, advertising, and distribution businesses for years to come.
• Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.
• Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

The Identity Engineering team provides critical consumer facing access, security, and identification services across The Walt Disney Company (TWDC). This includes our variety of brands like Disney, Hulu, ESPN, ABC, Marvel, and National Geographic to name a few. Nearly every digital consumer experience across the company relies on Identity Platform for mission critical business operations, including streaming video content on Disney+, booking Disney Parks and Resort vacations, playing ESPN Fantasy Football, buying products from Shop Disney and many more. These identity services are responsible for over 300 million guest and fan accounts, and billions of transactions per year. As part of the team, you will be tackling cutting edge issues that come with cloud-based infrastructures, platform resiliency requirements, security, and data migrations at scale. These challenges are regularly given on tight timelines, and we are looking for experienced engineering team members able to make the right decisions and drive them to execution. This position will serve as a primary contributor on the team as the team navigates the changing technology landscape. Data Engineers on the Disney Streaming Machine Learning and Innovation team develop and maintain systems and datasets that are used for Fraud/ATO/Bot Detection on Disney Streaming's suite of streaming video apps, notably Disney+ and Hulu. In this role you will partner with Applied Machine Learning Engineers and Data Scientists to help manage and scale processes to create algorithm input features and datasets. As a member of this team you will collaborate across Engineering and Data teams to identify internal and external data sources to design and implement ETL strategy, automation frameworks, and scalable data pipelines.

Responsibilities:
• Understand the key backend services and technical architecture.
• Lead the design, develop, maintain, ETL (Extract, Transform, Load) processes and data pipelines for rule-based fraud detection system.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement effective solutions.
• Analyze the security incident and provide the business solutions.
• Mentor engineers within your squad (and beyond!) to help them improve their technical ability and build their profile within and outside of the organization.
• Collaborate with your squad, Product Managers, Designers, QA, Operations, and other stakeholders to understand requirements and articulate technical decisions and outcomes.
• Promote and support Agile methodologies such as Scrum, Kanban, and Scrumban by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.

Basic Qualifications:
• Bachelor's degree in computer science or the related fields (or equivalent practical experience).
• Minimum 7 years of related experience.
• Proficient in Python or Scala and strong problem-solving skills.
• Experience on Spark is a MUST.
• Experience on AWS is a MUST.
• Experience on large scale data processing is a MUST.
• Solid knowledge of backend service development and distributed system development experience.
• Excellent communicant and collaboration skills.

Preferred Qualifications:
• Experience with data integration platforms is a plus (e.g., Databricks)
• Interested in both backend service development and data analysis

#DISNEYTECH

The hiring range for this position in New York is $156,300-$209,600 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

About Disney Direct to Consumer:

Disney's Direct to Consumer team oversees the Hulu and Disney+ streaming businesses within Disney Entertainment helping to bring The Walt Disney Company's best-in-class storytelling to fans and families everywhere.

This position is with Hulu, LLC, which is part of a business we call Disney Direct to Consumer.

Hulu, LLC is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, religion, color, sex, sexual orientation, gender, gender identity, gender expression, national origin, ancestry, age, marital status, military or veteran status, medical condition, genetic information or disability, or any other basis prohibited by federal, state or local law. Disney champions a business environment where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a constantly evolving world.

Jobcode: Reference SBJ-dyzjzm-44-222-82-133-42 in your application.