Manager, Experimentation and A/B Testing- Digital

Job Description

The Job
We are looking to hire a Manager, Experimentation on the Consumer Science team at CNN Digital. A successful candidate will help identify highest areas of impact and lead A/B and multivariate testing strategy, experiment design, prioritization, results analysis, and insights communication in close partnership with cross-functional web and app teams. He/she will define both long-term roadmap and manage day-to-day strategy and execution of A/B testing efforts. He/She must be confident and capable in a fast-paced and evolving digital media environment and be passionate about data-driven decision making. This position requires forward-thinking, endless curiosity, creativity, strong analytical skills, expertise on A/B testing platforms and best practices, and excellent communication and time management skills.

The Daily
• Championing and evangelizing test and learn methods and best practices, from opportunity discovery, through qualitative and quantitative testing, with a frequent iterative approach.
• Providing and leading A/B and multivariate testing strategy and ongoing coaching and education for supported cross-functional teams
• Promoting cross-team cooperation and communication of ideas, strategies, best practices and learned insights.
• Managing end-to-end experimentation process with supported cross-functional teams including: prioritization, documentation, experiment design, hypothesis definition, KPI selection, requirements gathering, experiment coordination
• Working cross-functionally to structure problems, develop hypothesizes, conduct analyses to turn data into meaningful insights and actionable recommendations through a rigorous data-driven process
• Identifying experiment-related product, technical, and analytics requirements to ensure proper execution and tracking of experiments
• Sizing and scoping testing opportunities and determining potential impact of ideas
• Owning the experiment results analysis and communicate insights and recommendations to cross-functional group of stakeholders
• Working with Experiment Analyst to evaluate the data from multiple sources to communicate insights and recommendations to cross-functional group of stakeholders and senior leadership
• Collaborating with Data Science, when relevant, on further and deeper analysis of experiment results
• Acting as air traffic controller to avoid test collisions and ensure validity of results
• Contributing to the development and enforcement of process, procedure, and governance of testing program
• Maintaining, managing, and monitoring operational status of supported experiment queues, build roadmaps, test schedules, and in-flight tests

The Essentials
• 3+ years of digital optimization and A/B and multivariate testing experience, serving as subject matter expert
• Passionate about deriving insights; intellectually curious and inquisitive
• Exceptional ability to synthesize multiple inputs (analytics, qualitative and quantitative insights, business direction) to arrive at recommendations that deliver customer-focused outcomes for the organization
• Change agent; not afraid to challenge the status quo, dealing constructively with disagreement
• Strong interpersonal written and verbal communication skills with the ability to deliver complex messages to diverse audiences
• Exceptionally organized with the ability to multi-task with multiple projects in a fast-paced environment with attention to detail
• Strong knowledge of A/B testing platforms and solid testing principles, preferably Optimizely
• Ability to thrive in a fast-paced newsroom environment
• Interest in working in a lean environment within a large organization, where continuous innovation is desired and ambiguity is the norm.
• Strong understanding of statistical analysis methods required
• Have a solid foundation of statistical and data science concepts
• Knowledge of key digital media KPI
• Experience working in a data environment that is large and complex - Solid understanding of qualitative testing practices
• Strong working knowledge of analytics platforms, eg Adobe Analytics
• Excellent analytical skills
• Knowledge of visual techniques for data analysis and presentation
• BS/BA in Math, Statistics, Engineering, Economics, Finance or related fields, or equivalent practical experience

Preferred Qualifications:
• Strong expertise in website or app instrumentation in a media environment
• Proficiency in statistical calculations in relation to A/B testing
• Tableau, Python, R, or similar statistical, visualization and/or dashboarding tools is a plus
• Knowledge of the digital media space, including the digital business models and the display advertising business is a plus.

The Perks
• Paid time off every year to volunteer
• Access to well-being tools, resources, and freebies
• 2018 Best Company for Working Mothers
2018 Best Company for Dads
• An in-house learning and development team to help shape and grow your career
• Part of the WarnerMedia family of powerhouse brands

Jobcode: Reference SBJ-rnby1r-216-73-216-239-42 in your application.