Full Time Job

Sr Data Engineer - Core Data Team


New York, NY 02-25-2021
Apply @ Employer
  • Paid
  • Full Time
  • Senior (5-10 years) Experience
Job Description
At Disney Streaming Services, data is central to measuring all aspects of delivering streaming video. The data engineering team is responsible for collecting, preparing, and processing extremely large volumes of data using public cloud and open source technologies. The data engineering team offers transparency into system operation, and guidance for performance optimizations.

If you are interested in joining Disney Streaming Services in the pursuit of not only crafting new media products but enjoying the products you build, we are interested in hearing from you.

• Develop high performance Spark ETLs in Scala and Python
• Develop unit/integration tests and data validations to ensure the quality of code and data
• Drive and maintain a culture of quality, innovation and experimentation
• Work in an Agile environment that focuses on collaboration and teamwork
• Coach data engineers best practices and technical concepts of building large scale data platforms

Basic Qualifications:
• 5+ years of relevant professional experience
• Experience with terabyte or petabyte scale data systems
• Proficiency in Scala (or willingness to learn)

Technology Skills & Experience:
• Proficiency with Scala or Python (preferably both)
• Traditional relational databases and/or distributed systems such as Hadoop/Hive, BigQuery, Redshift, Snowflake
• Streaming platforms such as Flink, Spark
• Workflow management tools such as Airflow
• Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase)
• Data exploration and data visualization tools such as Looker, Tableau, Chartio, Apache Superset, Plotly / Dash

Required Education

Bachelor's degree in Computer Science or related field or equivalent work experience

Preferred Education

Bonus for advanced degree in an analytical field such as economics, mathematics, or computer science

Additional Information:
• New York City preferred
• Remote possible for the right candidate who is willing to work EST hours from within the USA
Company Profile

Disney Streaming Services is responsible for developing and operating The Walt Disney Company’s direct-to-consumer video businesses globally, including the ESPN+ and Disney+.