Job description
Develop metrics and evaluation methodologies to measure the quality, accuracy, and usability of AI systems. Design and analyze online and offline experiments to quantify product improvements and identify opportunities for optimization. Build scalable data pipelines, dashboards, and analytical tools that enable continuous quality monitoring. Apply statistical analysis, machine learning, and data mining techniques to extract insights from large-scale datasets. Partner with engineering, research, and product teams to prioritize investments using data-driven recommendations. Investigate quality regressions, identify root causes, and propose measurable improvements. Shape best practices for AI evaluation, experimentation, and responsible AI measurement across multiple products. Communicate technical findings clearly to both engineering and business stakeholders. Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research) Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience. 3+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers). Experience presenting at conferences or other events in the outside research/industry community as an invited speaker. 3+ years experience conducting research as part of a research program (in academic or industry settings). 1+ year(s) experience developing and deploying live production systems, as part of a product team. 1+ year(s) experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping.