About the role

Aplyr's Quick Take

This role is focused on developing and optimizing multimodal AI models for human-computer interaction at Microsoft. You'll be researching machine learning algorithms, building data solutions, and collaborating with various teams. It's primarily an individual contributor role requiring strong technical skills in AI and programming.

Good fit

Ideal candidates are those with a PhD in Machine Learning or Computer Vision, or at least 3 years of relevant experience. You should be self-motivated, a problem solver, and comfortable working in a collaborative environment.

Worth noting

The position offers opportunities for publishing research and mentoring students, which is a unique upside. However, the job may involve high expectations for technical expertise and collaboration across teams.

Overview

The Spatial AI Lab is part of the Applied Sciences Group, a Microsoft research and development organization dedicated to creating next-generation human-computer interaction technologies leveraging the most recent AI developments and exploring new hardware capabilities and device form-factors. Our team of scientists and engineers has strong expertise in computer vision, multi-modal AI,spatial and embodied AI.  

Your main job will be to help create smart systems for new types of agents by training and improving multimodal AI models. This role will help you gain more experience in building and using AI models for Microsoft products and large-scale AI systems. You will also have the opportunity to join cutting edge research working with partners like ETH Zurich to publish in top-tier venues, present at workshops, and mentor students. 

 Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.   

Responsibilities

Responsibilities: 

Research novel machine learning algorithms and models.

Work on pre and/or post training of foundational multimodal models.

Build data and learning solutions for scalability, efficiency, and performance.

Curate training and evaluation datasets/benchmark.

Optimize models for CPUs, GPUs and NPUs and integrate into products.

Collaborate across Microsoft research and engineering teams.

Qualifications

Required Qualifications: 

A PhD in Machine Learning / Computer Vision or
3+ years of relevant industry experience.

Engineering skills in programming languages such as Python and/or C++.

Hands-on experience with modern deep learning frameworks (e.g. Pytorch/Tensorflow/Jax).

Self-motivated team-player, problem solver, and keen to learn.

Ability to present complex technical concepts to a diverse audience.

Preferred Qualifications: 

Experience in one or more of the following areas: 

Multimodal Models hands-on experience in any of the following topics:

Pre and/or post training of large vision language models;

Experience in techniques such as pruning, distillation and finetuning.

LLMs; Large vision-language models (VLMs);

Video generative models and diffusion algorithms; or

action-based transformers and Vision Language Action models (VLAs).

Large-Scale ML Systems Experience with large scale machine learning compute systems.

Publications Track record of impact, either via research publications at top-tier machine learning or computer vision conferences (NeurIPS, ICML, CVPR, ECCV, ICCV ), or via contributions to successful industry initiatives.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills & Tags

Aplyr's read

Microsoft is a technology giant shaping global computing, attracting talent interested in innovation and impact across software, cloud, and AI sectors.
Synthesized from recent postings & public sources

What's promising

•Strong commitment to innovation in AI and cloud computing.
•Diverse range of roles from technical to managerial, offering career growth.
•Financially stable with a robust global presence and market influence.

What to watch

•Complex organizational structure can slow decision-making processes.
•High competition for roles may limit entry-level opportunities.
•Potential for work-life balance challenges in high-demand positions.

Why Microsoft

•Pioneer in personal and business computing with a legacy of innovation.
•Extensive global reach with a diverse workforce and inclusive culture.
•Leader in integrating AI into mainstream software and cloud services.

Aplyr’s read is generated by AI from public sources. Was it useful?

About Microsoft

Microsoft

microsoft.com

View company

MSFT$499.99+0.03%

Microsoft is a global technology company that develops, licenses, and supports a wide range of software products, services, and devices. Known for its Windows operating system and Office productivity suite, Microsoft has a significant impact on personal and business computing worldwide.