Experimentation Manager

Job Description

Experimentation Manager

San Francisco, CA

We are looking for an experienced Experimentation Leader to develop and scale PlayStation's Experimentation Program. You will use your Program Leadership and expertise in Experimentation to drive significant impact on individual team's ability to rapidly test, learn, and iterate, while unlocking new opportunities for PlayStation's go-to-market strategies.

Responsibilities:
• Act as primary experimentation & optimization point of contact, consulting and supporting various business partners (Product, Engineering) in the development of their experimentation roadmaps and the design of specific actions
• Be the subject matter authority in experimentation (A/B, multivariate, etc.); understand our existing platform and how to optimize it for experimentation at scale
• Maintain and proactively monitor live experiments and ensure that appropriate metrics and segments are accurately implemented and reported, while consolidating and sharing findings across teams and verticals
• Be a reliable source of expertise for experimentation tools and offerings including keeping up to date with industry trends, services, and technologies
• Work with Product Management, senior leadership, and your peers, to develop the strategy for the future of experimentation at PlayStation (build/buy)
• Contribute to the creation of procedures and governance for a successful organization wide experimentation program at PlayStation and onboard new teams and individuals to the program
• Build and maintain leadership facing dashboards and reports. Increase visibility by communicating results and findings of individual experiments, as well as the overall program with partners
• Relentlessly communicate, coach, evangelize, document and share standard methodologies to colleagues across the company. Host hypothesis generation and experimentation ideation sessions to help teams build and prioritize their testing roadmap
• Increase experiment velocity by developing efficient processes and automating wherever possible
• Develop a center-of-excellence among key partners to enable the program to scale responsibly

Qualifications:
• 5+ years of experimentation experience (or equivalent) with proven expertise in implementing, running, and analyzing A/B tests and multivariate tests
• 5+ years leading and growing a company-wide experimentation program with multiple partners
• 3+ years in leading a team of experimentation analysts and data scientists delivering impactful analyses
• Strong familiarity with the methodology and statistics behind effective testing campaigns, with experience tailoring explanations of statistical and technical concepts to a variety of audiences
• Deep understanding of the tools that power automation, experimentation, personalization, attribution, and analytics. Strong technical skills - navigate APIs, databases, and system architecture
• Great partner management and collaboration with product managers, data, engineering and analytics teams
• Experience with testing platforms built-in house and/or 3rd parties (Optimizely, Target, Optymyze AB Tasty)
• Experience with Analytics Platforms including Adobe Analytics (Omniture), Google Analytics and/or similar analytics platforms
• Experience with SQL. Other programming languages (e.g., Python, R)
• Bachelor's degree or equivalent in a relevant field, such as economics, statistics, mathematics, or computer science

#LI-GD1

Jobcode: Reference SBJ-r116ex-18-189-22-136-42 in your application.