Principal Product Manager - Foundry Inferencing & Training (CoreAI - multiple roles)
Confirmed live in the last 24 hours
Microsoft
Compensation
$139,900 - $331,200/year
Job Description
Microsoft Foundry sits at the center of Microsoft’s AI strategy, powering how models are trained, evaluated, launched, and operated at global scale. Within CoreAI, the AI Models & Training organization is responsible for the platforms, infrastructure, and execution systems that turn cutting‑edge research into reliable, production‑ready AI capabilities.
We are looking for several Principal Product Managers to define our model ecosystem and offerings, to design product shape for inferencing and training. These roles operate at the intersection of model training, inference, experimentation, infrastructure, and developer platforms, and partner closely with engineering, research, data science, and leadership to deliver impact at scale.
These are highly cross‑functional roles, best suited for product leaders who thrive in ambiguity, bring strong technical fluency, and can translate complex systems into clear strategy, priorities, and outcomes.
Responsibilities
Product Strategy & Ownership
Own product strategy and roadmap across AI model training, inference, experimentation, and platform enablement, balancing near‑term delivery with long‑term scale
Maintain end‑to‑end accountability from concept through launch, iteration, and measurable impact
Model Lifecycle & Platform Enablement
Drive initiatives across the AI model lifecycle, partnering with engineering and research to bring new capabilities from research into production
Enable internal teams and customers to access, integrate, and adopt models through high‑quality platform experiences
Execution, Velocity & Operating Rigor
Lead complex, multi‑quarter initiatives with high visibility, managing dependencies, risks, and tradeoffs across teams
Improve execution velocity by reducing friction in planning, experimentation, launches, and iteration cycles
Experimentation, Metrics & Continuous Improvement
Define and track metrics for efficiency, performance, reliability, and adoption, using experimentation and data to drive decisions
Identify opportunities for automation, simplification, and continuous improvement as systems scale
Cross‑Functional Leadership & Communication
Act as a connective leader across engineering, data science, research, infrastructure, and go‑to‑market teams
Influence senior stakeholders through clear decision framing, executive‑ready narratives, and data‑backed recommendations
Qualifications
Required Qualifications
Bachelor’s Degree and 8+ years of experience in product management, technical program management, software engineering, or related technical fields (or equivalent experience)
Other Requirements
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications
Proven ability to lead product strategy and execution in highly technical, ambiguous, cross‑functional environments
Strong technical fluency and ability to partner deeply with engineering, infrastructure, or research teams
Excellent written and verbal communication skills, including executive‑level influence
10+ years of experience delivering large‑scale platforms, cloud services, or AI‑powered products
Experience with AI/ML platforms, model training systems, inference infrastructure, or experimentation frameworks
Familiarity with cloud infrastructure and distributed systems (e.g., GPUs, compute fleets, data pipelines)
Track record of launching and scaling complex products with measurable business or platform impact
Ability to operate as a force multiplier in fast‑paced, high‑stakes environments
Product Management IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
Product Management IC6 - The typical base pay range for this role across the U.S. is USD $163,000 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar Jobs
Carrier
Product Manager – AI / Analytics - LATAM
Caterpillar
Generative AI Product Manager – Shopping & Content Search
Wells Fargo
Technology Director - Gen AI Product Lead
Johnson & Johnson
Manager, AI Products
McKesson
Lead Technical Product Manager – Finance AI
Sanofi