Senior Analyst, DM&M Testing Analytics
Sephora
·Today
- Location
- San Francisco, CA,US, US
- Type
- Full-time
- Seniority
- Senior
- Experience
- 5+ years
- Education
- Bachelor
- Source
- Eightfold
Description
Own end-to-end measurement and analysis of Digital Marketing & Media tests, including preparing and validating data, quantifying incremental impact, and translating findings into clear business recommendations and storytelling. Partner with TCoE, Channel, and Line of Business teams to design effective experiments, including determining sample sizes, test and control cells, success metrics, and appropriate measurement approaches. Design and analyze marketing experiments using approaches such as A/B, holdout, factorial, multivariate, matched-market/geo testing, causal inference, and incrementality measurement. Identify and implement opportunities to use Claude to develop queries, investigate results, automate analytical workflows, and improve analytical efficiency while independently validating generated code and findings. Research and evaluate emerging testing methodologies through industry and vendor partnerships, adapting approaches to real-world Media and Retention considerations such as audience-size constraints, walled-garden data limitations, auction and platform learning dynamics, and privacy restrictions. Partner with TCoE and Marketing Effectiveness to evaluate testing tools and in-housing opportunities, develop and validate analytical prototypes, and establish workflows that integrate new solutions into ongoing testing. Maintain and evolve measurement standards, methodologies, and shared resources while building and sharing analytical expertise across Media and Retention. A bachelor's degree and 5+ years of hands-on marketing analytics and experimentation experience, including independently measuring Paid Media and Retention tests. 5+ years of strong SQL experience extracting, cleaning, validating, and analyzing audience and transaction data within a cloud data platform; Python or R experience is preferred. 5+ years of experience designing and analyzing marketing experiments, including A/B, holdout, factorial, multivariate, and matched-market/geo testing, as well as causal inference and incrementality measurement. Applied expertise in statistical experiment design and interpretation, including statistical power, significance, test validity, sample-size determination, and the independent creation of test and control groups. Experience selecting the right experimental and measurement approach for a business question; experience with Mastercard Test & Learn (APT) or a comparable experimentation platform is preferred. 1+ years of hands-on experience using Claude to develop queries, investigate analytical results, and automate workflows, including the ability to independently validate AI-generated code and findings. The ability to navigate ambiguity, frame loosely defined problems, and independently determine analytical approaches and next steps. A resourceful, self-directed mindset with the ability to investigate testing challenges, improve methodologies and tools, and carry solutions through execution. Strong business storytelling skills, with the ability to translate sophisticated analytical findings into clear, actionable recommendations for nontechnical partners. Collaborative judgment, attention to detail, and a passion for sharing expertise and strengthening experimentation practices across teams. #LI-AZ1