Hello Heart
Direct Greenhouse career site

Clinical AI Quality Specialist

Location
Remote (US)
Listed
Today
Free · No account needed

How well does your resume fit this job?

Upload your resume to see your score for this Hello Heart role, what matches, what's missing, and your best other matches.

Scored on our server and not saved there. The file stays in this browser so you don't have to upload it again after you sign up.

About the role

Hello Heart's AI team builds Nia, an AI health assistant for people managing their cardiovascular health. As a Clinical AI Quality Specialist, you will evaluate and monitor Nia's clinical behavior before and after release, working alongside the Clinical AI Quality & Governance Team Lead. You will run evaluations, review production conversations, and turn findings into documented decisions with product and engineering. This is a hands-on role for a clinician who is comfortable working with AI tools.

Responsibilities

  • Run Nia's offline evaluations for clinically relevant changes. Write test cases, including tricky and ambiguous ones, and score outputs against the expected clinical behavior. Build and maintain evaluation datasets and contribute to scoring methods
  • Review production conversations using defined sampling methods. Take part in the weekly review and help prepare monthly results that state what was and wasn't covered.
  • Test whether Nia detects and correctly handles high-risk situations, including medical emergencies, self-harm, and medication safety. Measure how often it escalates too much or too little.
  • Describe each failure clearly enough for engineering to act on, and flag your best read of the cause (for example, a wrong answer, missing patient context, or an escalation that fired too late). Make sure each unsafe or incorrect finding has an owner, a ticket, and a decision.
  • Keep clinical specifications, review records, and evidence current and auditable. Write clear, precise clinical assessments that engineering and product can act on.

Qualifications

  • PharmD (or equivalent clinical doctorate) with an active US license. 3+ years of combined clinical practice and clinical AI evaluation.
  • Questions assumptions and investigates before drawing conclusions. Reads current guidelines, drug labels, and primary sources, and cites them in written assessments. Uses AI tools to work faster, and verifies AI output against sources before relying on it.
  • Experience designing or running evaluations for LLM-based systems, reviewing production conversations, and using monitoring tools (e.g., Langfuse).
  • Command of triage and escalation, crisis and self-harm handling, and medication safety, grounded in current guidelines.
  • Comfortable working with AI tools and evaluation workflows.
  • Excellent written and verbal communication. Explains clinical risk clearly to engineering and product audiences, writes precise clinical assessments and documentation, and accepts feedback without defensiveness.
  • Genuine passion for how AI can improve preventive care and chronic disease management. Curious, open to learning, and comfortable with ambiguity and a fast-moving field.

Preferred Qualifications

  • Clinical experience in cardiovascular care or hypertension management.
  • Experience with structured rating of clinical transcripts, including agreement between raters.
  • Experience reviewing crisis and self-harm behavior.
  • Experience designing or running evaluations for LLM-based systems, or using monitoring tools such as Langfuse.

Pay and benefits

The United States base salary range for this full-time position is $130,000 to $143,000. Salary ranges are determined by role and level. Individual compensation is based on job-related skills, experience, and relevant education or training. Compensation details listed in United States job postings reflect annual salary and bonus only and do not include equity or benefits.

Hello Heart has a positive, diverse, and supportive culture - we look for people who are collaborative, creative, and courageous. Oh, and if you want to see some recent evidence of the fun things we do at Hello Heart, check out our Instagram page.

About Hello Heart

Hello Heart is on a mission to make heart attacks a thing of the past.

We're an AI company focused exclusively on heart health, building a platform that predicts and prevents cardiac events before they happen-identifying risk up to 10 days in advance versus 10 years in traditional clinical models.

This is already working at scale. Hello Heart has been shown to reduce inpatient hospital days by 47% and deliver ~$1,800 in annual savings per member. Hello Heart is the cardiac prevention partner to over 80% of large U.S. health plans and serves hundreds of public and private employers.

We're defining how the #1 cause of death-heart disease-is managed in the AI era. Join us.

Read the original posting

From Hello Heart's careers page, first listed on Rolev.ai on November 21, 2026. Rolev.ai is not the employer.

How Rolev.ai helps with this application

Rolev.ai is a job search and application tool for US job seekers. For this Clinical AI Quality Specialist role at Hello Heart, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.

  • See how you fit

    Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.

  • Tailor without inventing

    Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.

  • Draft the full kit

    Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.

  • 1-Click Extension Autofill

    The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.

Common questions

Where is the Clinical AI Quality Specialist job at Hello Heart located?

Yes, this Clinical AI Quality Specialist opening at Hello Heart is listed as Remote (US). Always check Hello Heart's application page for specific state eligibility or relocation policies.

How do I apply for the Clinical AI Quality Specialist position at Hello Heart?

This listing links directly to Hello Heart's Greenhouse application page. You can apply directly on Hello Heart's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Greenhouse application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.