About the role

Aplyr's Quick Take

This role is for an Engineering Program Manager focused on leading evaluation programs for AI and machine learning products, particularly those related to Siri and Apple Intelligence. You'll be coordinating between data scientists, engineers, and product teams to ensure high-quality AI experiences. It's a senior-level position requiring both technical expertise in evaluation methodologies and strong program management skills.

Good fit

Ideal candidates have 8+ years in program management, especially in AI or machine learning products, and a strong background in quantitative fields. You should be comfortable navigating ambiguity and enjoy collaborating across diverse teams.

Worth noting

The role emphasizes the need for a strong technical foundation in evaluation methodologies, which may limit applicants to those with specific experience in AI evaluation. The focus on building rigorous measurement frameworks suggests a high level of responsibility and influence on product quality.

Summary

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It’s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you’ll do more than join something — you’ll add something. We're looking for a Program Manager with a strong track record of building and leading effective evaluation programs demonstrating success leading via data. As a leader in the AIML Siri and Apple Intelligence evaluation team, you will lead initiatives in evaluation for foundation models and GenAI features powering Siri and Apple Intelligence experiences that are critical to Apple's future.

Description

You will work with top tier data scientists, engineers, research teams, and product teams across Apple to help ensure we deliver high-quality, safe, and beneficial AI-powered experiences that over 1 billion customers expect and love. This role requires technical depth in evaluation methodologies combined with strong program management expertise to drive comprehensive assessment of model capabilities, safety, helpfulness, and user experience quality.

Minimum Qualifications

Bachelor's degree in Statistics, Business Intelligence, Computer Science, other Quantitative Sciences, or related field and equivalent experience 8+ years of experience in driving large scale program building machine learning powered products or analytics to support product development 5+ years of experience managing programs in AI powered product space, preferably experience in evaluation of ML/AI products Ability to deal with ambiguities, drive disambiguation and clarities around evaluation methodologies, shepherd multiple teams to converge on rigorous measurement frameworks Experience designing and implementing evaluation systems for machine learning models, particularly large language models or conversational AI systems Program management skills including program structuring and managing multiple work streams interdependently across research, engineering, and product teams Problem-solving skills with attention to details in identifying edge cases, failure modes, and capability gaps Ability to communicate abstract ideas clearly, manage comprehensive yet succinct program status updates to all levels of audience, both verbally and in written forms Proven adaptability and agility in making adjustments to program strategy and plan with evolving model capabilities and product decisions

Preferred Qualifications

Master's or PhD degree in Statistics, Machine Learning, Computer Science, other Quantitative Sciences, or related field and equivalent experience Experience with statistical analysis and drawing meaningful conclusions from large-scale evaluation datasets Deep understanding of LLM capabilities, limitations, and safety considerations Self-sufficient in analyzing and drawing conclusions about model quality, user experience, and product opportunity from raw and refined evaluation data Player-coach capable of personally leading large evaluation initiatives while coaching team members along the way and mentoring team members to grow evaluation expertise

Aplyr's read

Apple is a tech giant known for its sleek design and innovation, attracting top talent in engineering, design, and business operations.
Synthesized from recent postings & public sources

What's promising

•Apple consistently leads in tech innovation with a strong focus on design and user experience.
•The company's global brand recognition offers employees a prestigious platform for career growth.
•Apple's robust ecosystem integrates hardware, software, and services, creating diverse job opportunities.

What to watch

•High-pressure work environment with demanding deadlines can impact work-life balance.
•Apple's secretive culture may limit transparency and cross-departmental communication.
•Dependence on hardware sales makes the company vulnerable to market saturation risks.

Why Apple

•Apple's design philosophy emphasizes simplicity and elegance, setting it apart in the tech industry.
•The company has a unique retail presence with its own stores enhancing customer experience.
•Apple's closed ecosystem creates a seamless integration across its products, unmatched by competitors.

Aplyr’s read is generated by AI from public sources. Was it useful?

About Apple

Apple

apple.com

View company

AAPL$290.55-3.64%

Apple Inc. is a leading technology company known for its innovative consumer electronics, software, and services. The company designs and manufactures products such as the iPhone, iPad, Mac computers, and wearables, significantly influencing the tech industry and consumer behavior worldwide.