Sr Data Engineer

Job Description

Overview

As Discovery Communications' portfolio continues to grow – around the world and across platforms – the Global Technology & Operations team is building media technology and IT systems that meet the world class standard for which Discovery is known. GT&O builds, implements and maintains the business systems and technology that are critical for delivering Discovery's products, while articulating the long-term technology strategy that will enable Discovery's growing pay-TV, digital terrestrial, free-to-air and online services to reach more audiences on more platforms.

From Amsterdam to Singapore and from satellite and broadcast operations to SAP, we are driving Discovery forward on the leading edge of technology.

The Global Data Analytics team enables Discovery Communications to turn data into action. Using big data platforms, data warehousing and business intelligence technology, audience data, advanced analytics, data science, visualization, and self-service analytics, this team supports company efforts to increase revenue, drive ratings, and enhance consumer engagement.

The Role

The Sr DataEngineer should be a technical contributor who has hands-on knowledge of all phases in building large-scale cloud based distributed data processing systems and applications. You will be part of the Global Data & Analytics engineering technology team and will partner closely with a team of data scientists, business analysts, Data Engineers and ETL Developers leading Discovery's cloud-based Analytics strategy.

You'll work on implementing AWS based big data ETL projects with a focus on Transforming, Merging and creating various DataMarts and centralized data warehouse using multiple technology platforms.

This position is responsible for extensive Analysis, design and development of Data warehouse projects to solve complex problems that require the consideration of operating systems capacity and limitations, operating time and form of desired results. Provides technical contribution in the development of detailed specifications from which programs will be written and perform design, coding, testing, debugging and documentation.

Responsibilities
• Design processes to extract, transform and load the source data to the targets and Data marts.
• Develop complex code to load data in to Data marts using AWS/EMR Spark and Scala
• Perform unit and system testing on the processes and resulting redshift data lake tables.
• Create test cases and test the data.
• Mentor others on the team with product functionality and provide guidelines and solutions on performance tuning techniques and industry best practices.
• Understanding the existing environment, translating into new environment requirements and planning tasks to meet those requirements.

Qualifications
• Bachelor's Degree or higher.
• Minimum of 3-6 years Software Industry experience
• 3 + years of development experience with AWS services.
• Experience creating and managing complex data architectures
• Experience with data warehousing databases Redshift, oracle and techniques
• 4+ years of extensive working knowledge in different programming.
• Proficiency working with structured, semi-structured and unstructured data sets including social, web logs and real time streaming data feeds
• Proficient with Jenkins, GitHub is preferred
• Experience with Snowflake is a must
• Must have legal rights to work in US

Jobcode: Reference SBJ-rbpv2x-18-217-108-11-42 in your application.