Senior Test Engineer
- Location
- San Francisco, CA · On-site
- Job type
- Full-time
- Level
- Senior
- Listed
- 30 days ago
Skills & highlights for this role
- Selenium
- Playwright
- test automation frameworks
- QMS validation
Also useful
- WebGL
- ML pipeline testing
Responsibilities
- Design, implement, and maintain end-to-end (E2E) automated test suites that exercise complete user workflows across UI, API, and back-end services, executing against the architecture and standards set by the Test Architect.
- Champion an AI-first automation strategy. Implement and scale test coverage using AI-assisted authoring and generative test planning derived from AI-generated requirements, while leveraging intelligent triage to minimize maintenance overhead.
- Build and own a baseline suite of daily smoke/build-acceptance tests covering core workflows across development and staging environments, closing a current gap where automated testing only runs during formal V&V cycles.
- Lead post-deployment testing activities, including production smoke tests, monitoring-driven verification, and continuous validation against live environments.
- Design and implement golden-dataset regression tests for HeartFlow's ML pipeline services, validating algorithmic outputs against curated reference cases.
- Build automated test coverage for HeartFlow's WebGL-based 3D Web Viewer and Clinical/CaseOps UIs using Playwright, including visual regression for 3D model rendering and view generation.
- Author clear, traceable test plans, test protocols, and test reports that meet the documentation expectations of a regulated medical device QMS.
- Perform tool validation for test infrastructure and automation tooling in accordance with internal QMS procedures and applicable standards.
- Build and maintain UI automation using Selenium and Playwright; extend frameworks for stability, parallelism, and reuse across product lines.
- Collaborate with software engineering teams to standardize API-level and integration tests using tools such as REST Assured, Postman, or Karate, including testing for DICOM ingestion and HL7 output validation at the hospital/cloud boundary.
- Partner with software engineers, product managers, and RA/QA to translate requirements into verifiable test cases with full traceability, contributing to closing the current gap between code commits and Ketryx-generated audit evidence.
- Triage and root-cause failures across complex distributed systems; drive defects to resolution and contribute to defect-prevention initiatives.
- Contribute to CI/CD pipelines so that automated tests run reliably and provide fast, actionable feedback to engineering teams.
- Support quality-related audits, CAPAs, and regulatory submissions by providing test evidence, traceability, and documentation.
- Support and coordinate offshore/contractor test engineers for overlapping product areas, helping ramp them on HeartFlow's systems and test standards.
- Mentor the Test Engineer role and contribute to hiring as the team scales.
Qualifications
- 5-8 years of experience in software test engineering, SDET, or quality engineering roles, with a strong hands-on automation background.
- Required: Direct experience testing Software as a Medical Device (SaMD) or other regulated medical device software.
- Required: Working knowledge of medical device QMS practices and applicable standards (e.g., ISO 13485, IEC 62304, ISO 14971, 21 CFR Part 820), including test documentation, traceability, and tool validation.
- Required: Strong proficiency with Selenium / WebDriver and Playwright, including framework design, page-object patterns, and stability/flake reduction techniques.
- Demonstrated experience designing and maintaining E2E automation frameworks that cover complete workflows and system integrations.
- Experience authoring test plans, protocols, and reports in a regulated environment, with attention to traceability between requirements, test cases, and evidence.
- Practical experience with AI-assisted testing tools and techniques (e.g., AI-augmented test authoring, self-healing automation, LLM-driven test generation or triage).
- Solid programming skills in Python and at least one additional mainstream language used for automation (e.g., TypeScript/JavaScript, Java, or C#).
- Experience with API testing tools (REST Assured, Postman, Karate, Pact.io or equivalent) and basic familiarity with contract testing concepts.
- Experience integrating automated tests into CI/CD pipelines (e.g., GitHub Actions, Harness) and working with cloud environments such as AWS.
- Strong analytical and debugging skills across distributed systems, with a structured approach to root-cause analysis.
- Excellent written and verbal communication skills; able to clearly document test designs, defects, and risk.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Desired
- Direct experience with requirements/traceability tooling such as Ketryx, Jama, or Polarion.
- Experience with DICOM and/or HL7 protocols, or other clinical data interoperability standards.
- Experience supporting RA/QA teams during regulatory audits and inspections.
- Experience testing ML/AI systems, clinical validation workflows, or medical imaging products, including statistical or tolerance-based regression approaches.
- Experience validating complex visualizations (qualitative and quantitative) such as 3D models, overlays, or measurement views.
- Experience generating and managing diverse test datasets (synthetic, anonymized, adversarial).
- Experience coordinating or mentoring offshore or contractor test engineers.
- Familiarity with non-functional / performance testing tools (e.g., k6, Locust, JMeter, Gatling).
- Exposure to data-pipeline testing and microservices architectures.
- Contributions to defining and tracking actionable quality metrics.
Pay and benefits
A reasonable estimate of the base salary compensation range is $165,000 to $205,000, bonus, and equity. #LI-IB1
Positions posted for Heartflow are not intended for or open to third party recruiters / agencies. Submission of any unsolicited resumes for these positions will be considered to be free referrals.
Heartflow has become aware of a fraud where unknown entities are posing as Heartflow recruiters in an attempt to obtain personal information from individuals as part of our application or job offer process.
About HeartFlow
Heartflow is a medical technology company advancing the diagnosis and management of coronary artery disease, the #1 cause of death worldwide, using cutting-edge technology.
The flagship product-an AI-driven, non-invasive cardiac test supported by the ACC/AHA Chest Pain Guidelines called the Heartflow FFRCT Analysis-provides a color-coded, 3D model of a patient's coronary arteries indicating the impact blockages have on blood flow to the heart.
Heartflow is the first AI-driven non-invasive integrated heart care solution across the CCTA pathway that helps clinicians identify stenoses in the coronary arteries (RoadMap™Analysis), assess coronary blood flow (FFRCT Analysis), and characterize and quantify coronary atherosclerosis (Plaque Analysis). Our pipeline of products is growing and so is our team; join us in helping to revolutionize precision heartcare.
Heartflow is a publicly traded company (HTFL) that has received international recognition for exceptional strides in healthcare innovation, is supported by medical societies around the world, cleared for use in the US, UK, Europe, Japan and Canada, and has been used for more than 750,000 patients worldwide.
The Senior Test Engineer is a hands-on individual contributor on the Test Engineering team, responsible for end-to-end system testing, post-deployment verification, and the design and execution of automated test suites that protect the quality of our regulated SaMD products.
Working under the technical direction set by the Test Architect, this role takes primary ownership of building out automated coverage across HeartFlow's pipeline from the ML/AI algorithms and clinical computation services through the Workstation, web applications, and reporting layers while applying the rigor required of a medical device environment.
This role also plays a key part in scaling the team, supporting and coordinating offshore/contractor test engineers as HeartFlow's automation program grows. The ideal candidate brings deep technical expertise in modern UI automation frameworks (Selenium and Playwright), experience writing test plans and validating tools under a QMS, and a track record of shipping high-quality software in a regulated SaMD context.
Equal opportunity and legal notices
Heartflow is an Equal Opportunity Employer.
We are committed to a work environment that supports, inspires, and respects all individuals and do not discriminate against any employee or applicant because of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law.
This policy applies to every aspect of employment at Heartflow, including recruitment, hiring, training, relocation, promotion, and termination.
From HeartFlow's careers page, first listed on Rolev.ai on October 10, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Senior Test Engineer role at HeartFlow, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
All Test Engineer jobs- QA EngineerKnox Systems · Arlington, VA
- Lead SDETWispr Flow · San Francisco, CA
- Staff QA EngineerTatari · San Francisco, CA
- Quality assurance (Software Tester cum Programmer)Beta.SoftSystems · Jersey City, NJ
- Software Development Engineer in TestGecko Robotics · Pittsburgh, PA
- QA Automation EngineerImpiricus · Atlanta, GA
Common questions
Where is the Senior Test Engineer job at HeartFlow located?
This Senior Test Engineer position at HeartFlow is located in San Francisco, CA (On-site). Always check HeartFlow's application page for specific state eligibility or relocation policies.
What qualifications are required for Senior Test Engineer at HeartFlow?
For the Senior Test Engineer role, HeartFlow highlights experience with Selenium, Playwright, test automation frameworks, QMS validation. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the Senior Test Engineer position at HeartFlow?
This listing links directly to HeartFlow's Greenhouse application page. You can apply directly on HeartFlow's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Greenhouse application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.