About the role

Aplyr's Quick Take

This role is about building and maintaining the infrastructure for AI model training and evaluation at Microsoft. It's a hands-on engineering position focused on developing scalable services and tools, collaborating with both engineering and research teams. You'll be working in a startup-like environment within Microsoft, aiming to advance AI capabilities while ensuring safety and alignment with human values.

Good fit

Ideal candidates are experienced software engineers with a strong background in cloud infrastructure and AI systems. You should thrive in collaborative, fast-paced environments and be comfortable with hands-on technical work.

Worth noting

The team operates like a startup within Microsoft, which may appeal to those looking for a dynamic work culture. The emphasis on humanist values in AI development is a unique aspect of this role.

Overview

Help build the infrastructure that powers training, evaluation, and data platforms for reliable deployment of world-class foundational AI models. We are on a mission to create state-of-the-art AI models and deploy them across Microsoft products at an unprecedented scale.

You’ll collaborate across engineering and research to design, evolve, and operate core research infrastructure, so that product teams can train faster, evaluate more rigorously, and ship with confidence. You’ll work closely with the teams that transform pre-trained models into the consumer Copilot experience.

Microsoft’s mission is to empower every person and every organization to achieve more, and we build on values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive.

Microsoft Superintelligence Team

This role is part of Microsoft AI's Superintelligence Team. The MAIST is a startup-like team inside Microsoft AI, created to push the boundaries of AI toward Humanist Superintelligence—ultra-capable systems that remain controllable, safety-aligned, and anchored to human values. Our mission is to create AI that amplifies human potential while ensuring humanity remains firmly in control. We aim to deliver breakthroughs that benefit society—advancing science, education, and global well-being.

We’re also fortunate to partner with incredible product teams giving our models the chance to reach billions of users and create immense positive impact. If you’re a brilliant, highly-ambitious and low ego individual, you’ll fit right in—come and join us as we work on our next generation of models!

Responsibilities

Design and build core platform services for scalable training and evaluation, including cluster orchestration, job scheduling, data and compute pipelines, and artifact management.
Standardize containerized workflows by maintaining Docker images, CI/CD, and runtime configurations; advocate for best practices in security, reproducibility, and cost efficiency.
Implement end-to-end observability and operations through metrics, tracing, logging, dashboard development, monitoring, and automated alerts for model training and platform health (using Prometheus, Grafana, OpenTelemetry).
Architect and operate services on Azure cloud platforms, managing infrastructure-as-code (Terraform/Helm), secrets, networking, and storage.
Enhance developer experience by creating tools, CLIs, and portals that simplify job submission, metrics analysis, and experiment management for generalist software engineering and research teams.
Enforce security and compliance policies for data access, container hardening, and supply-chain integrity, and partner with security and privacy teams to maintain robust practices in multi-tenant environments and secret management.
Collaborate cross-functionally with data, model, and product teams to align infrastructure roadmaps with training needs, evaluation protocols, and Copilot product goals.

Qualifications

Required skills

Strong software engineering background building reliable, scalable production systems (Python preferred)
Hands‑on experience supporting large‑scale ML / LLM training, evaluation, or experimentation infrastructure
Operating GPU‑heavy workloads in cloud environments using Docker and Kubernetes (scheduling, utilization, isolation)
Designing and running data / compute pipelines and orchestration (e.g., Airflow, Argo) with object storage (Azure Blob / S3)
Platform reliability and operability: observability, metrics, logging, tracing, alerting (Prometheus, Grafana, OpenTelemetry)

Desired skills

Building secure, reproducible platforms using CI/CD, infrastructure‑as‑code (Terraform, Helm), container security, and secrets management
Experience working closely with AI researchers in fast‑moving, experimental, frontier‑scale research environments and building internal tools (CLIs, portals, APIs) to boost productivity

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills & Tags

Aplyr's read

Microsoft is a technology giant shaping global computing, attracting talent interested in innovation and impact across software, cloud, and AI sectors.
Synthesized from recent postings & public sources

What's promising

•Strong commitment to innovation in AI and cloud computing.
•Diverse range of roles from technical to managerial, offering career growth.
•Financially stable with a robust global presence and market influence.

What to watch

•Complex organizational structure can slow decision-making processes.
•High competition for roles may limit entry-level opportunities.
•Potential for work-life balance challenges in high-demand positions.

Why Microsoft

•Pioneer in personal and business computing with a legacy of innovation.
•Extensive global reach with a diverse workforce and inclusive culture.
•Leader in integrating AI into mainstream software and cloud services.

Aplyr’s read is generated by AI from public sources. Was it useful?

About Microsoft

Microsoft

microsoft.com

View company

MSFT$399.76+2.31%

Microsoft is a global technology company that develops, licenses, and supports a wide range of software products, services, and devices. Known for its Windows operating system and Office productivity suite, Microsoft has a significant impact on personal and business computing worldwide.