RealityKit Spatial UI Rendering Engineer, Vision Products Software

AppleSunnyvale

Posted 22 hours agoStill open, checked 28m ago

About the job

Shape the future of spatial computing by building the rendering technologies that bring Apple's user interfaces into three dimensions. As part of the RealityKit team, you'll architect and optimize the systems that turn conventional app interfaces into spatial experiences, delivering exceptional visual fidelity, responsiveness, and power efficiency on Apple's next-generation vision products.

Operating at the intersection of Core Animation, SwiftUI, and RealityKit, you'll advance the architecture that renders windows, text, and controls as spatial content in real time. You'll also shape RealityView, the API through which developers combine app UI with 3D content. Your work will define the visual quality and performance characteristics of spatial UI, establishing the foundation on which developers and users interact with apps across Apple's vision ecosystem. Description
As a Spatial UI Rendering Engineer on the RealityKit team, you'll own the rendering quality, power, and performance of spatial UI and RealityView. You'll drive the evolution of the rendering pipeline that brings Core Animation content into RealityKit, and develop the GPU techniques necessary to ensure UI elements maintain exceptional clarity and performance under spatial viewing conditions. Your scope includes texture resolution and filtering strategies, foveated and multi-view rendering of UI content, and the shader and render-pass optimizations that preserve the clarity of text and controls while minimizing GPU, memory, and power cost.

You'll also own how RealityView renders app UI and 3D content together, from the underlying rendering integration to the developer-facing behavior and APIs. You'll address complex rendering challenges, including maintaining legibility as viewing distance and render resolution change, rendering UI and 3D content together seamlessly, managing large texture workloads efficiently, and sustaining stable frame rates, memory, and power across extended sessions. You'll collaborate closely with the Core Animation, UI frameworks (UIKit, AppKit, and SwiftUI), Metal, and GPU teams to deliver cohesive solutions that meet Apple's standards for performance and user experience.