Sr. Manager, Product Insights & Experimentation

Job Description

Find out more information at HBOMax.com.

The Job
The Sr. Manager of Product Insights and Experimentation will help the product team define and execute a meaningful test and learn agenda, comprised of both small and big loop tests that significantly grow the business. The ideal candidate will have experience with A/B tests, offline evaluation and simulations, and can collaboratively work with product and engineering leaders to meaningfully translate business requirements into solutions.

The Daily
Leadership & Mentoring
• Recruit and mentor staff to build a world-class data team.
• Help to lead the vision for the experimentation platform, driving a technical strategy and business agenda.

Experimentation
• Lead analysis and execution of experiments in the areas of customer acquisition, streaming quality, application performance, and commerce.
• Share and promote experimentation best practices.

Analysis automation
• Effectively scale analysis from a single A/B test to standardize metric definitions, statistical tests and results visualizations.

Deep analysis
• Analyze user behavioral data to identify patterns, uncover opportunities, and create a common understanding of how people are interacting with the product.

Partnership
• Partner closely with the experimentation platform team, product managers, data engineers to improve platform capabilities, drive development of new features and testing strategies.

The Essentials
• 5+ years of hands-on experience designing and executing A/B and MV tests. Experience with Optimizely preferred.
• 3+ years of experience using SQL.
• 3+ years of Python or other statistical programming language.
• 2+ years leadership experience (includes people management, mentoring interns, technical leadership, and project management).
• Deep understanding of statistical concepts like hypothesis testing, Bayesian decision-making, etc.
• Hands-on experience in advanced data analysis
• Strong communication skills, for both technical and non-technical audiences.
• Have a demonstrated history of translating complex data sets into clear and actionable narratives and communicate opportunities and challenges to stakeholders
• Experience and aptitude to deliver high-quality solutions on short timelines

Nice to Haves
• Experience with bandit optimization, adaptive experimentation, and large-scale inference methods preferred.
• Knowledge of observational causal inference and design (regression adjustment, propensity matching) or quasi-experimental design preferred.
• Experience thinking strategically to interpret market and consumer information, preferably about a subscription service or large e-commerce business.
• Familiarity with data exploration and data visualization tools like Tableau or Looker.
• Advanced degree in an analytical field or equivalent experience.

The Perks
• Paid time off every year to volunteer
• Access to well-being tools, resources, and freebies
• 2018 Best Company for Working Mothers
• 2018 Best Company for Dads
• An in-house learning and development team to help shape and grow your career
• Part of the WarnerMedia family of powerhouse brands

Jobcode: Reference SBJ-ro1863-18-118-120-204-42 in your application.