Lead Data Scientist

Job Description

Lead Data Scientist (Personalization & Algorithm Evaluation)

Data Scientists on the Disney Streaming Machine Learning and Innovation team develop, maintain, and evaluate recommendation and personalization algorithms for Disney Streaming's suite of streaming video apps, notably Disney+ and Hulu. They specialize in applying advanced machine learning methods and analysis techniques (statistical modeling, experimentation, causal inference) to meet strategic product personalization goals, and constantly seek ways to optimize operational processes.

Responsibilities:

This is an Individual Contributor leadership role in the area of content recommendation. As a member of this team you will collaborate across Engineering, Product, and Data teams to analyze user behavioral data to better understand how people are interacting with our platforms and content recommendations in order to drive algorithm and product improvements. The role has a specific focus on the area of pre-production metrics for algorithm evaluation - responsibilities include codifying pre-production metrics for product features, closing the performance gap between offline and online evaluation, and designing and owning automated reporting tools and processes.
- Analysis and Algorithm Optimization: Perform deep dive analysis on product interactions and user profiles as they relate to algorithm output in order to drive improvements in key personalization metrics
- Pre-production metric design and ETL:
Own pre-production algorithm metric design by defining metrics and evaluation criteria and by establishing upstream ETL requirements for metrics calculations
- Dashboard and Report Design and Automation: Establish a house reporting style and work with Data Scientists and Data Engineers to leverage automation and alerting tools
- Partnership and Messaging: Partner closely with stakeholders on Product, Engineering, and Data teams to identify and unlock opportunities in the area of algorithm evaluation and testing, and manage messaging around pre-production algorithm performance

Basic Qualifications:
• ​​​​5+ years of analytical experience using Python or R
• 5+ years using SQL
• 3+ years of experience performing analysis of user behavior as it relates to a technology product
• In-depth understanding of machine learning algorithm design and evaluation
• In-depth understanding of statistical concepts such as hypothesis testing, experimental design, causal inference, and counterfactual evaluation
• Experience with data exploration and data visualization tools such as Looker, Tableau, etc.
• Experience with cloud services in a production environment (particularly AWS)
• Experience loading and querying cloud-hosted databases such as Snowflake
• Ability to explain how models are used and algorithms behave to both technical and non-technical audience
• Ability to gauge the complexity of machine learning problems and a willingness to execute simple approaches for quick, effective solutions as appropriate
• Strong written and verbal communication skills

Preferred Qualifications:
• Experience building and deploying full stack ML pipelines: data extraction, data mining, model training, feature development, testing, and deployment
• Familiar with metadata management, data lineage, and principles of data governance
• Familiarity with automated deployment and CI / CD tools
• Experience with model evaluation (IR evaluation, recommender system evaluation)
• Experience using Spark or Scala
• Familiarity with Python development ecosystem and technologies such as Databricks and Spark

Preferred Education
• Master's or PhD in statistics, math, computer science, social science, or related quantitative field

Additional Information:

Location - New York, NY preferred but also open to US Remote for the right candidate

#DisneyTech

This role is considered hybrid, which means the employee will work a portion of their time on-site from a Company designated location and the remainder of their time remotely. A remote opportunity may be possible for qualified candidates under certain circumstances and, if granted, the employee would work remotely on an ongoing basis.

About Disney Streaming:

Comprised of the Company's international business units and various direct-to-consumer streaming services, Disney Media & Entertainment Distribution (DMED) aligns technology, media distribution and advertising sales into a single business segment to create and deliver personalized entertainment experiences to consumers around the world.

About The Walt Disney Company:

The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise with the following business segments: media networks, parks and resorts, studio entertainment, consumer products and interactive media. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney's stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.

This position is with Disney Streaming Technology LLC, which is part of a business we call Disney Streaming.

Disney Streaming Technology LLC is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Disney fosters a business culture where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a rapidly changing world.

Jobcode: Reference SBJ-rz6q01-3-145-74-54-42 in your application.