Job description
Apple's vision products — our head-worn compute platforms (HMD and glasses) — are designed to become the fastest way to do serious, detailed work when paired with Mac, faster than a laptop alone. This role owns the systems architecture for fusing spatial inputs (hand, wrist, eye, and head tracking) with the keyboard, mouse, and trackpad connected to Mac, targeting a meaningful improvement in input efficiency without adding physical or cognitive fatigue. You will define how discrete input modalities combine into one continuous interaction model, and you will be the one who proves — with data — that people can type, point, select, and manipulate faster on our vision products than on any other platform, while feeling just as comfortable as they do today. As a Systems Engineer, you will own the architecture that lets our vision products fuse spatial sensing with best-in-class keyboard, mouse, and trackpad input when plugged into Mac. Your mandate: make our vision products the world's most efficient mechanism for detailed, sustained productive work.
You will:
Define the system-level architecture for fusing spatial input (hand, wrist, eye, head) with keyboard/mouse/trackpad signals into a single, low-latency interaction model
Set and validate an ambitious input-efficiency improvement target against Mac-only baselines, across representative productivity tasks (text entry, navigation, selection, precision pointing)
Own the specification for how our vision products preserve best-in-class high-rate text input — keyboard remains the backbone for speed; fusion must augment it, not compete with it
Build the measurement methodology and test harness for input efficiency (throughput, error rate, correction cost) and for fatigue/comfort (physical and cognitive), and treat the two as co-primary metrics — no speed win counts if it costs comfort
Decompose the fused-input experience into system requirements and drive them through sensor, firmware, input-stack, and macOS-integration teams
Partner closely with Sense & Constellation (sensor selection/config), Display Systems (latency budget), hand/eye tracking, human factors, and product design to land a coherent end-to-end spec
Run structured human-performance studies, own the resulting data, and be the team's authority on what's actually faster versus what only feels faster
You will:
Define the system-level architecture for fusing spatial input (hand, wrist, eye, head) with keyboard/mouse/trackpad signals into a single, low-latency interaction model
Set and validate an ambitious input-efficiency improvement target against Mac-only baselines, across representative productivity tasks (text entry, navigation, selection, precision pointing)
Own the specification for how our vision products preserve best-in-class high-rate text input — keyboard remains the backbone for speed; fusion must augment it, not compete with it
Build the measurement methodology and test harness for input efficiency (throughput, error rate, correction cost) and for fatigue/comfort (physical and cognitive), and treat the two as co-primary metrics — no speed win counts if it costs comfort
Decompose the fused-input experience into system requirements and drive them through sensor, firmware, input-stack, and macOS-integration teams
Partner closely with Sense & Constellation (sensor selection/config), Display Systems (latency budget), hand/eye tracking, human factors, and product design to land a coherent end-to-end spec
Run structured human-performance studies, own the resulting data, and be the team's authority on what's actually faster versus what only feels faster