Experimentation Test Operations Manager

Job description

Primary Job Responsibilities

Ebay's Experimentation platform is a world-recognized, leading edge experimentation suite for Ebay.com web and mobile applications. We run over 1500+ tests a year across buying, selling, checkout and other functions, across over 25 international sites and countries. We need a top-talent Test Operations Manager to support product A:B testing on the live eBay site including responsibility of launching and ramping experiments, managing experimentation design, workflow, approvals and configuration. This role will be responsible for experiments sponsored by certain business groups and act as primary liaison representing the test management organization to product, Analytics and business organizations. You might be a career experimentation junkie, or product manager / project manager with Ecommerce/Web experience who is passionate about experimentation.
• Design, configure and launch experiments on Global Ebay sites
• Interface with Product Development / Product Management domains teams, Site Operations, Customer Service, assist with troubleshooting, config changes, test setup recommendations, triaging issues
• Provide expertise and guidance on effective AB test setup and configuration
• Document and maintain the roadmap for current and future tests. Support other Test Managers and business teams in test prioritization process.
• Provide weekly status updates to analysts, PD/PM stakedholders and business teams on the status and changes
• Drive the weekly test management meetings and gather updates from all members on what's happening in their world that the Experimentation team needs to be aware of and plan for.
• Maintain test management dashboard, tools to ensure status, variants and tests details are all properly communicated.
• Analyze and refine test process, approvals, workflows, and work with engineers to enhance internal test portal, tools and utilities
• Document lessons learned and enable entire team through continuous improvement

Job Requirements

·  Bachelors or Masters in Computer Science, Physical Sciences, Mathematics, Economics, Analytics or Engineering Discipline Preferred
·  3+ years experience in Ecommerce with exposure or working knowledge of Experimentation / A:B testing / Multivariate (MVT) testing. Experience might be in product management, project management, analytics, engineering or a mix of those roles.
·  Candidates should have a mix of experience in the following – might be stronger in one or the other, or a mix of all:
·  Working knowledge of basic math and statistics related to experimentation: Normalization, Confidence Intervals, Error, P-values, etc.
·  Working knowledge of Web/Mobile/Ecommerce Architectures, knowledge large-scale distributed systems and services oriented architectures a plus
·  Experience with web analytics / user behavior / AB testing software: Omniture Site Catalyst, Core Metrics, Web Trends, Google Analytics, Splunk, Tealeaf, Adobe Target, or other
·  Experience with Dashboard / Reporting / Business Intelligence Software like Microstrategy, Tableau, Business Objects
·  Ability to interface with team members at all levels, from individual contributor up to executive
·  Thought leader able to find creative solutions to challenging problems minimizing cost and maximizing value for customers

Job Title

Product Manager 2 - Technical

Removal Date

31-Oct-2017