OpenAI
Direct Ashby career site

Model Policy Manager, Emerging AI Misuse

Location
San Francisco, CA (Remote)
Listed
Today
Free · No account needed

How well does your resume fit this job?

Upload your resume to see your score for this OpenAI role, what matches, what's missing, and your best other matches.

Scored on our server and not saved there. The file stays in this browser so you don't have to upload it again after you sign up.

About the Role

As AI systems become more capable, the same advances that expand their legitimate uses can also lower barriers to harm. Emerging misuse risks range from AI assistance with conventional weapons development and the misuse of AI-enabled robotics to fraud, impersonation, and other forms of abuse that people can carry out at scale using AI agents. You’ll build threat models for how people could misuse AI in digital and physical settings, assess what access to AI changes in practice, and use that evidence to define how models should respond.

This role is based in San Francisco. We offer relocation support and work from the office three days a week, with optional work from home on Thursdays and Fridays.

In this role, you will

  • Build and update threat models as capabilities evolve. Assess what people could plausibly do, what expertise and resources they would need, and how AI changes those barriers.
  • Define when models should help, limit assistance, or refuse in situations where the same capability has legitimate and harmful uses.
  • Turn expert safety judgment into instructions, training examples, and evaluations that teach models when to help, when to limit assistance, and when to refuse.
  • Turn threat models into evaluation scenarios and grading guidance. Analyze model outputs, red-team findings, and deployment data to identify where models enable misuse or block legitimate work.
  • Partner with research, engineering, security, and product teams to apply findings to model training, deployment decisions, and monitoring.

You might thrive in this role if you

  • Have hands-on experience building, testing, or assessing dual-use technologies, or a track record of threat modeling grounded in how people use and misuse real systems.
  • Demonstrate deep practical experience in one relevant domain and the judgment to know when to bring in experts from others.
  • Are able to assess whether a capability demonstrated in a test materially changes what someone could do outside it.
  • Can translate technical evidence and uncertainty into clear policy boundaries and measurable evaluation criteria.
  • Have experience analyzing gold sets, evaluation results, and training data to spot inconsistent human labels, assess how annotator disagreement affects measured performance, and decide what to investigate next.
  • Are comfortable working hands-on with model data and evaluation results, including inspecting examples, analyzing failure patterns, assessing data quality, and distinguishing policy failures from grader, model, or system failures.
  • Use empirical evidence to develop and refine safety policies and safeguards.
  • Work well across disciplines and revises their judgment as capabilities and evidence change.
  • Enjoy fast-paced, collaborative research environments where priorities shift as models, evidence, and risks change.

Relevant Publications

  • Introducing the Model Spec
  • Managing frontier AI risk: From training to deployment
  • GPT-6.2 System Card (Astra and Sol)
  • OpenAI Deployment Safety Hub

About the Team

The Model Policy team within OpenAI’s Safety Systems organization defines how increasingly capable AI models should behave in real-world settings. We turn research on emerging risks into model behavior policies, evaluations, and safeguards.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form No response will be provided to inquiries unrelated to job posting compliance.

Read the original posting

From OpenAI's careers page, first listed on Rolev.ai on November 21, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this Model Policy Manager, Emerging AI Misuse role at OpenAI, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

Where is the Model Policy Manager, Emerging AI Misuse job at OpenAI located?

Yes, this Model Policy Manager, Emerging AI Misuse opening at OpenAI is listed as San Francisco, CA (Remote). Always check OpenAI's application page for specific state eligibility or relocation policies.

How do I apply for the Model Policy Manager, Emerging AI Misuse position at OpenAI?

This listing links directly to OpenAI's Ashby application page. You can apply directly on OpenAI's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.