Advertising Experimentation Analyst

Job Description

Responsibilities
Welcome to Peacock, the dynamic new streaming service from NBCUniversal. Here you'll find more than a job. You'll find a fast-paced, high-flying team for unique birds that want to be at the epicenter of technology, sports, news, tv, movies and more. Our flock works hard to connect people to what they love, each other and the world around them by creating shared experiences through culture-defining entertainment.

As a company, we embrace the power of difference. Our team is committed to creating an organization that champions diversity and inclusivity for all by curating content and a workforce that represents the world around us. We continue to challenge ourselves and the industry by being customer-centric, data-driven creatures of innovation. At Peacock, we are determined to forge the next frontier of streaming through creativity, teamwork, and talent.

Here you can fly to new heights!

Introducing Peacock, NBCUniversal's new streaming service that combines timeless shows and movies, exclusive originals, kids programming and current hits, with timely news, sports and pop culture. All together. All in one app.

We are building a world-class team of smart, hungry and fearless professionals who are energized by the possibility of working at the epicenter of content, technology and culture. Join us if you would like to be a part of this exciting initiative.

We are seeking an Advertising Experimentation Analyst to help support our A/B/n testing efforts in advertising experience and product. With the vast amount of advertising and viewing content available from the ever-evolving and fast-paced advertising experience and product development at Peacock, we will need a smart and capable individual to support the A/B and multivariate testing lifecycle, spanning from sifting through large amounts of data for insights into experimentation, generating informed hypotheses and objectives for data-informed prioritization, designing and conducting tests for statistical power and significance in continuous and iterative optimization, to analyzing statistical results and presenting data-driven actions to a multifunctional team of stakeholders in business and technology.

The candidate should have statistical skills with randomized controlled experimental design (e.g., KPIs, bucketing, sample size, power, statistical significance), statistical skills (e.g., regression, linear algebra, probability), a programming language for data analysis (e.g., SQL, Python, R), and cloud computing experience (e.g., Google Cloud Platform, Big Query, Tableau, Google Data Studio).

This role will sit within the larger Decision Sciences team. The goal of the Decision Sciences team is to deliver and champion intelligent use of data that drives a best-in-class customer experience and fuels product growth. The Advertising Experimentation Analyst, therefore, should be able to thrive in a collaborative working environment by partnering with other Decision Sciences teams, including Data Science, Data Engineering, Data Measurement, Product Analytics, and NBCU and Peacock advertising business.

Responsibilities include, but are not limited to:
• Driving A/B/n and multivariate experiments to directly impact the company's optimization strategy for advertising experience and product to ultimately drive incremental CLV (customer lifetime value) growth
• Partnering with advertising stakeholders to translate business requirements into testing hypotheses and experiment designs of robust statistical and technical soundness, and ultimately actionable insights into continuous optimization
• Designing, conducting, and analyzing experiments administered to treatment groups against control and holdout groups via statistical modeling to ensure statistical power and significance for accurate lift measurement
• Performing segmentation analyses to inform distinct user subgroups' engagement with advertising content and editorial content in the broad experimentation ecosystem
• Developing reporting dashboards and visualizations to streamline the experimentation process and to present results to key stakeholders in an intuitive and self-serve fashion

Qualifications/Requirements
• Master's and Bachelor's degrees in statistics, mathematics, or related field
• One to two years of work experience in academic research and/or internships using statistics to resolve business cases
• Proven academic skills and/or internship experience in an A/B/n and multivariate testing
• Statistical skills in applying hypothesis testing, calculating critical value, defining p-value, and using z-test, t-test, ANOVA, or chi-square test
• Proficiency of at least one programming language for data analysis (i.e., Python, R), cloud-based relational SQL database (e.g., Google Cloud Platform BigQuery), big data based visualization experience (e.g., Tableau, Google Data Studio)
• Experience querying data in data warehouse systems (e.g., AWS, Snowflake, BigQuery)
• Ability to translate statistical concepts and probability theories to a general audience

Jobcode: Reference SBJ-rje3q1-3-146-37-35-42 in your application.