Staff Software Engineer, Compute Infrastructure
Confirmed live in the last 24 hours
CoreWeave
Compensation
$188,000 - $275,000/year
Job Description
What You’ll Do:
As a Staff Software Engineer, you’ll shape the backbone of our GPU-driven data centers—powering some of the most advanced workloads in AI and large-scale computing. This isn’t just about keeping the lights on; it’s about architecting the next generation of reliable, secure, and massively scalable infrastructure.
The METALDEV team builds and operates a suite of Go-based services that power large-scale datacenter deployments. These platforms automate complex workflows while providing deep observability and monitoring for tens of thousands of GPU servers and diverse infrastructure components—including CDUs, PDUs, and NVLink switches. Our tooling is designed for next-generation rack systems like NVIDIA GB200 and GB300, as well as a broad range of GPU server platforms.
- Provide technical leadership in designing, architecting, and operating large-scale infrastructure services for GPU servers, with a focus on security, reliability, and scalability.
- Build and enhance infrastructure services and automation, including inventory management systems and lifecycle management solutions using open source technologies.
- Drive strategic direction for infrastructure automation, lifecycle management, and service orchestration, making MetalDev core services more scalable and resilient.
- Define best practices for API development (REST/gRPC), distributed databases, and Kubernetes orchestration—while mentoring engineers to follow your lead.
- Partner with hardware, software, and operations teams to align infrastructure with business impact.
- Contribute to open source communities (e.g., Go, Redfish) through collaboration and technical thought leadership.
- Lead and improve CI/CD pipelines for hardware compliance, firmware management, and data systems.
- Champion reliability and operational excellence by driving observability (Prometheus/Grafana), production incident response, and continuous service improvement.
Who You Are:
- B.S., M.S., or PhD in Computer Science or related field, or equivalent experience.
- 8+ years of software engineering experience with a strong focus on infrastructure, cloud engineering, and distributed databases—particularly within large-scale datacenter and cloud environments.
- Expertise in Go and proven experience building REST/gRPC APIs for mission-critical platforms.
- Strong background in architecting and scaling cloud-native Kubernetes infrastructure and distributed services.
- Proven success in mentoring engineers, leading technical projects, and influencing engineering strategy across teams.
- Experience contributing to and collaborating with open source communities.
- Skilled in applying a data-driven approach to reliability, optimization, and continuous improvement.
- Excellent communicator able to work effectively with both technical and non-technical stakeholders.
- Hands-on experience with observability stacks (Prometheus, Grafana, PromQL), CI/CD pipelines, and operating large fleets of GPU servers.
- Track record of leading incident response, postmortems, and driving robust service reliability.
Preferred:
Similar Jobs
Roblox
Senior Software Engineer, Compute Fleet Management
Coinbase
Senior Software Engineer, Infrastructure - Platform Compute
CoreWeave
Senior Platform Engineer II, Compute Services
Aurora Innovation
Senior Software Engineer - Compute
Feedzai
Platform Engineer - Compute
Feedzai