Job description
Apple is where individual imaginations gather together, committing to the values that lead to great work. It's the diversity of our people and their thinking that inspires the innovation running through everything we do — here, you'll do more than join something, you'll add something.
The AIML Evaluation team measures how well Apple's intelligence features, including Siri AI actually work in our customers' hands.
We're looking for an organized, critical problem solver who thinks beyond what a feature is supposed to do and finds creative ways to measure the qualitative experience. As a Sr Engineering Specialist on the Evaluation team, you'll keep our evaluation projects running clean from design through delivery. You'll be responsible for understanding how well our products perform, advocating for the changes that matter, and representing how our customers will experience them. We're a nimble, fast-paced team that runs on a tight partnership between Feature/ Tooling Engineering, Program Management, Operations, and Data Science — and this role sits at the center of it.
In this role, you will:
Own device configuration for evaluation projects, and coordinate with the Operations team to roll out configurations to all testers.
Monitor in-progress projects and flag quality issues early, before they affect downstream results.
Partner with Evaluation Data Science to review evaluation design for quality and alignment ahead of launch.
Drive triage with the evaluation tooling team when technical issues surface mid-project, and follow through to resolution.
Turn recurring problems into durable fixes — checklists, guardrails, and process improvements that hold up across future projects.
Success in this role looks like projects that launch on a sound design, run without avoidable surprises, and produce results the team can act on with confidence.
The AIML Evaluation team measures how well Apple's intelligence features, including Siri AI actually work in our customers' hands.
We're looking for an organized, critical problem solver who thinks beyond what a feature is supposed to do and finds creative ways to measure the qualitative experience. As a Sr Engineering Specialist on the Evaluation team, you'll keep our evaluation projects running clean from design through delivery. You'll be responsible for understanding how well our products perform, advocating for the changes that matter, and representing how our customers will experience them. We're a nimble, fast-paced team that runs on a tight partnership between Feature/ Tooling Engineering, Program Management, Operations, and Data Science — and this role sits at the center of it.
In this role, you will:
Own device configuration for evaluation projects, and coordinate with the Operations team to roll out configurations to all testers.
Monitor in-progress projects and flag quality issues early, before they affect downstream results.
Partner with Evaluation Data Science to review evaluation design for quality and alignment ahead of launch.
Drive triage with the evaluation tooling team when technical issues surface mid-project, and follow through to resolution.
Turn recurring problems into durable fixes — checklists, guardrails, and process improvements that hold up across future projects.
Success in this role looks like projects that launch on a sound design, run without avoidable surprises, and produce results the team can act on with confidence.