Sr Data Engineer - Core Data Team

Job Description

At Disney Streaming Services, data is central to measuring all aspects of delivering streaming video. The data engineering team is responsible for collecting, preparing, and processing extremely large volumes of data using public cloud and open source technologies. The data engineering team offers transparency into system operation, and guidance for performance optimizations.

If you are interested in joining Disney Streaming Services in the pursuit of not only crafting new media products but enjoying the products you build, we are interested in hearing from you.

Responsibilities:
• Develop high performance Spark ETLs in Scala and Python
• Develop unit/integration tests and data validations to ensure the quality of code and data
• Drive and maintain a culture of quality, innovation and experimentation
• Work in an Agile environment that focuses on collaboration and teamwork
• Coach data engineers best practices and technical concepts of building large scale data platforms

Basic Qualifications:
• 5+ years of relevant professional experience
• Experience with terabyte or petabyte scale data systems
• Proficiency in Scala (or willingness to learn)

Technology Skills & Experience:
• Proficiency with Scala or Python (preferably both)
• Traditional relational databases and/or distributed systems such as Hadoop/Hive, BigQuery, Redshift, Snowflake
• Streaming platforms such as Flink, Spark
• Workflow management tools such as Airflow
• Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase)
• Data exploration and data visualization tools such as Looker, Tableau, Chartio, Apache Superset, Plotly / Dash

Required Education

Bachelor's degree in Computer Science or related field or equivalent work experience

Preferred Education

Bonus for advanced degree in an analytical field such as economics, mathematics, or computer science

Additional Information:
• New York City preferred
• Remote possible for the right candidate who is willing to work EST hours from within the USA

Jobcode: Reference SBJ-rbq38x-3-139-72-14-42 in your application.