Software Engineer II - Agentic AI, Internal Developer Platforms
Confirmed live in the last 24 hours
CoreWeave
Compensation
$109,000 - $160,000/year
Job Description
What You’ll Do
As a Software Engineer II on IDP you’ll help build the platform and services that enable agentic developer workflows and the control plane for AI developer tooling. You’ll work on components across our Agentic Dev Workflow stack — helping create well-defined developer tool APIs, MCP servers and registry entries, high-quality knowledge/context pipelines, and safety/observability for agentic experiences used by engineers across CoreWeave. This role is an excellent fit if you enjoy building developer-facing systems, integrating LLM-driven features into tooling, and shipping reliable, production services that other engineers rely on.
In this role, you will
- Build and maintain internal developer platforms that power local development, automated testing, and ephemeral (preview) environments.
- Design, implement, and operate MCP servers that wrap developer tools (CW-CLI, CI/CD, env APIs, observability, etc.) so LLMs and agents can call them in a safe, structured way.
- Contribute MCP server templates, SDKs, and registry metadata (ownership, permissions, versioning, stability, safety level) to make it easy for teams to expose services to agents.
- Integrate and harden AI-enabled developer capabilities (code scaffolding, test generation, post-PR assistance, release agents) into our platform while enforcing policy, validation, and audit trails.
- Implement spec-driven development flows: index specs and docs, enable RAG/structured retrieval, and ensure agent outputs are validated against specs and policy checks.
- Implement safety guardrails and observability for agent actions: RBAC/scoped tokens, logs and traces, explainability, and deterministic validation checks.
- Partner with Security, SRE, DevEx, and product teams to design endpoints, test harnesses, dry-run modes, and rollback/ idempotency semantics so agent-driven operations are safe and reversible.
Investing in our people is one of our top priorities, and we value candidates who can bring their diversified experiences to our teams. Here are some qualities we’ve found compatible with our team. We'd love to talk about whether this aligns with your experience and interests and what you’re excited to work on next.
Who You Are
- 3+ years professional experience building production services or infrastructure.
- Experience operating services at scale, including monitoring/alerting and incident response.
- Comfortable using Python/Go as a primary language with demonstrated strong systems/programming skills and willingness to become productive in Go.
- Experience with containerization and orchestration (Docker, Kubernetes) and IaC / CI systems (GitHub Actions, ArgoCD, Terraform, etc.).
- Experience building scalable development/test environments, ephemeral preview environments, or developer tooling.
- Experience in LLM/AI-powered developer tooling (code suggestion, code intelligence, RAG pipelines, AI Agents and Agentic Workflows).
Preferred Qualifications
- Direct experience integrating LLMs, building MCP-style wrappers, or creating machine-friendly tool contracts/SDKs.
- Experience with knowledge/context indexing (semantic search, Sourcegraph, RAG), observability for agent actions, and audit trails.
- Fa
