About the role

Aplyr's Quick Take

This role is for a Research Engineer focused on developing evaluations for AI models specifically in the finance sector. You'll be responsible for identifying key capabilities in financial reasoning, designing performance metrics, and refining evaluation methods. It's an individual contributor role that requires both technical skills and a passion for AI safety.

Good fit

Ideal candidates have 2-3 years of technical experience, strong engineering and statistical analysis skills, and a keen interest in AI evaluations. You should be detail-oriented, adaptable, and able to thrive in a fast-paced research environment.

Worth noting

The role emphasizes ownership of research threads and cross-functional collaboration, which may appeal to those looking for autonomy. The focus on finance could be a niche area, so experience in that domain may be beneficial.

About the team
The Frontier Evals team builds north star model evaluations to drive progress towards safe AGI/ASI. This team builds ambitious evaluations to measure and steer our models, and creates self-improvement loops to steer our training, safety, and launch decisions. Some of the team's open-sourced evaluations include SWE-bench Verified, MLE-bench, PaperBench, and SWE-Lancer, and the team built and ran frontier evaluations for GPT4o, o1, o3, GPT 4.5, ChatGPT Agent, and GPT5. If you are interested in feeling firsthand the fast progress of our models, and steering them towards good, this is the team for you.

About you
We seek exceptional research engineers that can push the boundaries of our frontier models in the finance domain. We are looking for those who will help shape AI evaluations of financial reasoning and related capabilities, and will own individual threads within this endeavor end-to-end.

In this role, you'll:

Identify important model capabilities, skills, and behaviors that are crucial to financial workflows, and design methods to quantify performance in these areas
Own and pursue a research agenda to identify an important model capability (especially as it relates to financial reasoning) and build evals to measure it
Continuously refine evaluations of frontier AI models to assess the extent of frontier capabilities

We expect you to:

Have strong engineering and statistical analysis skills (with at least 2-3 years of full-time technical experience)
Be passionate about evals for real world applications and knowledge work
Be detail-oriented and thorough
Be a team player / willing to do a variety of tasks to move the team forward
Be passionate and knowledgeable about AGI/ASI measurement
Be able to operate effectively in a dynamic and extremely fast-paced research environment as well as scope and deliver projects end-to-end

It would be great if you also have:

An ability to work cross-functionally
Excellent communication skills

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see

Skills & Tags

go rust aws ai data product design

Aplyr's read

OpenAI is a pioneering AI research organization focused on developing AGI to benefit humanity, attracting talent keen on ethical and innovative AI solutions.
Synthesized from recent postings & public sources

What's promising

•OpenAI is at the forefront of AI research, driving innovation in artificial general intelligence.
•The company emphasizes ethical AI development, appealing to those passionate about responsible technology.
•OpenAI offers diverse roles across engineering, sales, and creative fields, indicating a dynamic work environment.

What to watch

•OpenAI's rapid growth may lead to organizational challenges and resource strain.
•The focus on AGI poses inherent risks and ethical dilemmas that require careful navigation.
•Limited public information about internal culture and work-life balance may concern potential applicants.

Why OpenAI

•OpenAI's mission to ensure AGI benefits all of humanity sets it apart in the tech industry.
•The organization combines cutting-edge research with a strong emphasis on ethical AI practices.
•OpenAI's diverse hiring across global markets reflects its commitment to international impact and collaboration.

Aplyr’s read is generated by AI from public sources. Was it useful?

About OpenAI

OpenAI

openai.com

View company

OpenAI is an artificial intelligence research organization that aims to ensure that artificial general intelligence (AGI) benefits all of humanity. They develop advanced AI technologies and promote safe and responsible AI practices.