Experimentation Analyst

Job Description

Experimentation Analyst

San Francisco, CA

We are looking for an Experimentation Analyst to join our Product Analytics team who will be responsible for the planning, execution, analysis, collaboration, and documentation of experimentation and optimization projects on PlayStation platform under the supervision of Experimentation Manager, Product Analytics. Key areas of responsibility include experiment configuration and deployment support, experiment performance reporting and visualization, partnership with multiple engineering, product and analytics teams and great communication skills.

Responsibilities:
• Design A/B test experiments, review and validate test data, conduct analysis, and report results working with data scientist in the experimentation team
• Maintain, QA, and monitor progression of live and staged experiments within the experimentation platform. Analyze volume and call tests when statistical relevancy and minimal detectable lift is reached. Complete post-test analysis, summary, and readout for partners.
• Explore and segment data to identify and explain key drivers; design and build models, dashboards, and visualizations to support Product teams
• Work in close collaboration with data engineering, software development, data sciences, user experience and product management teams to define experimentation requirements and metrics, and then conceptualize, design, and execute embedded analytical tools and solutions for these experiments.
• Independently extract and integrate data from multiple big data systems to support analytical efforts, including writing complex SQL queries, analyze in-app customer journeys through Adobe Analytics or Google Analytics.
• Research and recommend experimentation standard methodologies. Participate in the usage and growth of our digital tools, reporting visualization skills, analytical storytelling, etc.

Qualifications:
• Bachelor's Degree in Marketing, Business Analytics, Mathematics, Statistics, Data Science, Business, or related course of study required or equivalent work experience. Related Master's Degree a plus
• 2+ years of experience using data to conduct experiments, supporting experimentation and optimization: A|B, split, multivariate analysis
• 2+ years of experience working with product leads, product managers, software engineering and user experience design teams
• 2+ years of relevant experience in data analysis with advanced SQL programming skills, high level of independence required
• 2+ years of demonstrable experience with web tools including Adobe Analytics, Google Analytics, and standard BI Tools (MicroStrategy, Business Objects, , Cognos, etc.)
• Experience with testing platforms built-in house and/or 3rd parties (Optimizely, Target, Optymyze, AB Tasty)
• Experience with data visualization tools (Qlikview, Tableau, Spotfire)
• Understanding of statistics concepts (e.g. confidence intervals, hypothesis testing, regression analysis)
• Demonstrable expertise in various analytic modeling techniques including multivariate/linear regression, k-means clustering, etc. is preferred
• Expert skills in Microsoft Office (Work, Excel, Access, Project, and PowerPoint) as well as Visio to prepare and present analysis results
• Strong written & verbal communication skills

#LI-GD1

Jobcode: Reference SBJ-reze15-13-58-39-23-42 in your application.