Principal Software Engineer, Storage Infrastructure
MicrosoftRedmond, WA,US
PrincipalFull-timePosted last monthStill open, checked 4h ago
About the job
Design, build, and evolve distributed storage systems and file systems for cloud-scale AI training and inference workloads. Architect and operationalize storage stacks for large Kubernetes clusters, optimizing data access, throughput, latency, scalability, and reliability for GPU-accelerated workloads. Design storage and KVkey-value caching architectures that improve LLM inference latency, throughput, resource utilization, and cost efficiency. Improve durability, availability, performance, and operational maturity through automation, observability, diagnostics, incident response, and resiliency engineering. Analyze complex cross-layer production issues, identify root causes, and implement durable improvements across storage, compute, networking, and runtime components. Partner with infrastructure and machine learningLLM platform teams to deliver end-to-end capabilities for foundation-model pre-training, post-training, fine-tuning, and inference. Lead architecture reviews, influence long-term storage strategy, mentor engineers, and establish engineering practices for secure and reliable cloud services. Embody our Culture and Values Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python Additional or preferred qualifications Experience operating highly available, fault-tolerant services in production environments, including troubleshooting complex distributed-system failures. Experience applying storage concepts such as durability, replication, consistency, performance, and reliability to production system design. Experience leading technical design reviews or delivering cross-team engineering projects across software, infrastructure, networking, or platform components. Experience with geo-distributed storage architectures, replication, disaster recovery, business continuity, or regional failover. Experience designing storage platforms for large-scale Kubernetes clusters supporting AI training or inference. Experience with high-performance caching or key-value KV caching for LLM inference. Experience using machine learning or AI techniques for anomaly detection, forecasting, incident management, capacity planning, or operational automation.
