Back

Manager, Protection Scientist Engineer, Intelligence and Investigations

OpenAIOpenAI·Artificial Intelligence

Apply effort

~7 min

Ashby

Posted

243 days

01

About the role

About the Team

OpenAI’s mission is to ensure that general-purpose artificial intelligence benefits all of humanity. We believe that achieving our goal requires real world deployment and iteratively updating based on what we learn.

The Intelligence and Investigations team supports this by identifying and investigating misuses of our products – especially new types of abuse. This enables our partner teams to develop data-backed product policies and build scaled safety mitigations. Precisely understanding abuse allows us to safely enable users to build useful things with our products.

About the Role

Protection Science Engineering is an interdisciplinary role mixing data science, machine learning, investigation, and policy/protocol development. As a manager of Protection Scientist Engineers, you will lead a small but growing team of PSEs who design and build systems to proactively identify and enforce on abuse on OpenAI’s products. This includes ensuring we have robust abuse monitoring in place for new products, sustaining monitoring for existing products, and prototyping and incubating systems of defense against our highest risk harms. The team also responds to and investigates critical escalations, especially those that are not caught by our existing safety systems. The team, and you, will leverage expert understanding of our products and data, and work cross-functionally with product, policy, and scaled engineering teams.

This role is based in our San Francisco office and may involve resolving urgent escalations outside of normal work hours. Some investigations and work may involve sensitive content, including sexual, child safety, violent, or otherwise-disturbing material.

In this role, you will:

  • Lead, manage, and support an interdisciplinary and technical team across US timezones, working with them to chart longer term strategies.

  • Leverage your expertise in designing, launching, and improving systems of defense to mentor the team and develop both technical and organisational solutions.

  • Identify and create opportunities to enhance and make more efficient the team’s core work through understanding both cross-functional and technical challenges.

  • Review, and at times design and participate in, the implementation of abuse detection, review, and enforcement for new product launches and major harms.

  • Work with Product, Policy, Ops, and Investigative teams to understand key risks and how to address them, and with Engineering teams to ensure we have sufficient data and scaled tooling.

  • Communicate the work of the team, at times externally, and coordinate with cross-functional partners to scope and prioritize work across abuse response.

You might thrive in this role if you:

  • Have at least two years of experience managing or tech leading teams that fight threats at a tech company and/or government organization.

  • Have deep experience with technical analysis and harm detection, especially using SQL and Python.

  • Have experience in trust and safety and/or have worked closely with policy, enforcement, and engineering teams. An investigative mindset is key.

  • Have experience with basic data engineering, such as building core tables or writing data pipelines in production, and with machine learning principles and execution. Basic software development skills are a plus as this role writes productionised code.

  • Have experience scaling and automating processes, especially with language models.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

02

Aplyr's read

OpenAI is a pioneering AI research organization focused on developing AGI to benefit humanity, attracting talent keen on ethical and innovative AI solutions.

Synthesized from recent postings & public sources

What's promising

  • OpenAI is at the forefront of AI research, driving innovation in artificial general intelligence.
  • The company emphasizes ethical AI development, appealing to those passionate about responsible technology.
  • OpenAI offers diverse roles across engineering, sales, and creative fields, indicating a dynamic work environment.

What to watch

  • OpenAI's rapid growth may lead to organizational challenges and resource strain.
  • The focus on AGI poses inherent risks and ethical dilemmas that require careful navigation.
  • Limited public information about internal culture and work-life balance may concern potential applicants.

Why OpenAI

  • OpenAI's mission to ensure AGI benefits all of humanity sets it apart in the tech industry.
  • The organization combines cutting-edge research with a strong emphasis on ethical AI practices.
  • OpenAI's diverse hiring across global markets reflects its commitment to international impact and collaboration.

Aplyr’s read is generated by AI from public sources. Was it useful?

03

About OpenAI

OpenAI is an artificial intelligence research organization that aims to ensure that artificial general intelligence (AGI) benefits all of humanity. They develop advanced AI technologies and promote safe and responsible AI practices.

04

Similar roles