Full Time Job

Lead Ml Engineer


San Francisco, CA 11-09-2020
  • Paid
  • Full Time
  • Senior (5-10 years) Experience
Job Description

The Machine Learning (ML) Engineering team at Disney Streaming Services drives and enables ML usage across several domains in heterogeneous language environments and at all stages of a project's life cycle, including ad-hoc exploration, preparing training data, model development, and robust production deployment. The team is invested in continual innovation of the ML infrastructure itself to carefully orchestrate a continuous cycle of learning, inference, and observation while also maintaining high system availability and reliability. We seek to find new ways to scale with our guest and partner base as well as the ever-growing need for ML and experiments.

We're looking for a Lead ML Engineer interested in building optimized, efficient and reliable products, services and interfaces to federate access to data stores, simplify, automate and manage the ML development and deployment ecosystem. In addition, the ideal candidate would be excited about partnering with various data science, analytic and experimentation teams to gather requirements, seek feedback, and focus on continuous development and improvement of the ML infrastructure.

• Design and develop infrastructure for the full cycle of machine learning such as workflow orchestration and management interfaces, data discovery tools, data quality and feature libraries.
• Experience designing and developing backend microservices for large scale distributed systems using gRPC or REST.
• Ability to guide multi-faceted projects with engineers from diverse backgrounds, heterogeneous skills and across teams.
• Experience with large-scale distributed data processing systems, cloud infrastructure such as AWS or GCP, and container systems such as Docker or Kubernetes.
• Drive and maintain a culture of quality, innovation and experimentation
• Mentor colleagues on best practices and technical concepts of building large scale solutions
• Work in an Agile environment that focuses on collaboration and teamwork

Basic Qualifications:
• 5+ years of relevant software engineering experience
• Passion for turning ideas into products and improving the member experience
• Skills in OO programming (Python, Java, Scala or C++)
• Excellent communication and people engagement skills

Preferred Qualifications:
• Familiarity with developing and deploying Spark and ML pipelines
• Hands on experience with big data technologies such as Hadoop, HDFS, Airflow, Databricks, Jupyter, Kinesis, Kafka
• Experience building backend microservices for large scale distributed systems
• Conversant in AWS and cloud computing technologies

Required Education

BS or MS in Computer Science or equivalent

Company Profile

Disney Streaming Services is responsible for developing and operating The Walt Disney Company’s direct-to-consumer video businesses globally, including the ESPN+ and Disney+.