Principal Engineer, IaaS
About this role
We’re seeking a Principal Engineer to be a hands-on technical leader across our core Infrastructure-as-a-Service (IaaS) platform - the compute, high-performance networking, and storage foundation that every CoreWeave customer and product is built on. Your mission: make this infrastructure scale automatically and seamlessly while delivering the performance, reliability, and efficiency the world’s largest AI workloads demand. You’ll own everything from multi-tenant control and data planes to the low-level data path, prototype new capabilities, set engineering standards, and work shoulder-to-shoulder with compute, networking, storage, platform, and product teams to make CoreWeave the infrastructure platform for AI.
What you’ll do
Technical Vision & Strategy - Set technical direction for the IaaS org and make architectural decisions that influence systems well beyond any single team. Establish standards for how foundational infrastructure is designed, built, and operated.
Infrastructure Architecture - Design and implement highly scalable, multi-tenant control and data planes spanning compute, networking, and storage. Build foundational IaaS services including GPU and bare-metal compute provisioning, high-performance network fabrics, and exabyte-scale storage (S3-compatible object storage, block storage, and distributed filesystems), and integrate dedicated infrastructure into diverse customer environments.
Performance Engineering - Work across the data path with technologies such as RDMA, GPU Direct, RoCE, InfiniBand, SPDK, virtualization, and Kubernetes to optimize throughput, latency, and efficiency. Benchmark and eliminate bottlenecks across the compute, network, and storage layers.
Operational Excellence - Improve the reliability, durability, scalability, and observability of the platform end to end. Partner with operations teams to monitor, analyze, and optimize infrastructure using telemetry, metrics, and dashboards.
Hands-on Development - Write production code in a systems language (Go, C, C++, or Rust) for control planes, system services, and tooling. Stay deep in the low-level details that drive performance and durability.
Mentorship & Collaboration - Coach engineers on building distributed, high-performance systems, and work cross-functionally to deliver seamless, well-integrated infrastructure capabilities across the stack.
Who you are
8-10+ years building infrastructure, distributed systems, or cloud services in production.
Strong hands-on experience operating large-scale systems across one or more core domains: compute and virtualization, high-performance networking, or storage (object, block, or distributed filesystems).
Proficiency in a systems programming language such as Go, C, C++, or Rust.
Solid understanding of cloud-native infrastructure, Kubernetes, and scalable system architecture.
Strong debugging and problem-solving skills in distributed, high-performance environments, with an instinct for where bottlenecks and failure modes live.
Excellent communicator who influences architecture across teams and distills complex trade-offs for engineers, executives, and customers.
Bachelor’s, Master’s, or PhD in CS, EE, or related field (or equivalent practical experience).
Nice-to-have
Experience with high-performance data-path technologies (RDMA, GPU Direct, RoCE, InfiniBand, SPDK) or large-scale provisioning, scheduling, and orchestration systems.
Familiarity with the trade-offs across infrastructure hardware choices, such as HDD vs SSD storage tiers and network fabric selection.
Background operating infrastructure for AI/ML or other GPU-accelerated, high-throughput workloads.
Publications/talks on large-scale distributed systems or infrastructure.
Why CoreWeave?
You’ll be a technical spearhead for the infrastructure that powers an industry-defining AI cloud, enabling researchers, enterprises, and OSS communities to run breakthrough models at massive scale. If building the world’s most performant, reliable, and scalable infrastructure platform excites you, we’d love to chat.
The base salary range for this role is $206,000 to $275,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).