QA Reviewer, Data Annotation
- Location
- Palo Alto, CA · On-site
- Level
- Mid-level
- Experience
- 2+ years
- Listed
- 20 days ago
Skills & highlights for this role
- data annotation QA
- inter-annotator agreement metrics
- root-cause analysis
Also useful
- multi-camera video annotation
- point cloud data
- robotics training data
Responsibilities
- Run calibration sessions: Lead weekly alignment meetings with internal reviewers and vendor partners to ensure everyone grades and labels data with high consistency.
- Track and fix quality issues: Spot common reviewer errors, conduct root-cause analysis on labeling discrepancies, and build feedback loops to eliminate systemic mistakes.
- Update guidelines and documentation: Keep labeling instructions, edge-case taxonomies, and SOPs clear, crisp, and up-to-date as project requirements evolve.
- Monitor quality metrics: Track quality scores, accuracy rates, and inter-annotator agreement metrics across dashboards to ensure production targets are met.
- Provide feedback and guidance: Deliver direct feedback and targeted training to reviewers navigating complex guidelines or multi-sensor data edge cases.
- Coordinate cross-functionally: Work closely with technical leads, operations, and annotation teams to resolve taxonomy questions quickly and keep the data flywheel moving smoothly.
Requirements
- 2-4 years of experience in quality assurance, data annotation QA, or data review in high-velocity tech or AI environments.
- Meticulous attention to detail: A sharp eye for subtle edge cases and a practical, logical approach to resolving ambiguous data scenarios.
- Clear communication: Strong written and verbal communication skills with the ability to explain complex labeling rules clearly and facilitate alignment discussions.
- Data fluency: Comfortable navigating dashboards, spreadsheets, and basic reports to track accuracy metrics and spot trends.
- Collaborative mindset: A proactive, team-oriented attitude focused on coaching reviewers and continually driving quality across the organization.
- Experience with multi-camera/ego-exo video annotation, point cloud data, or robotics training data pipelines (is a plus).
- Background working with third-party vendor teams (BPO/managed services) in a fast-paced hardware or AI deployment environment (is a plus).
About Mind
Mind Robotics is building Physical AI for real-world industrial deployment, starting with the factory floor. We believe the hardest problems in AI are solved when researchers and engineers are hands-on with the physical world every day - and we're looking for people who are passionate about robotics, value ownership, and are excited to tackle difficult problems. Join us if you want to move beyond digital intelligence and put intelligence into motion.
About the Team and the Role
We are looking for a QA Reviewer & Calibration Lead to ensure our data annotation pipeline operates at high throughput without sacrificing quality. In this role, you will be the backbone of quality control for our continuous data flywheel. You will lead regular alignment sessions, identify systematic labeling inconsistencies, and work hands-on with internal reviewers and partner teams to resolve ambiguous edge cases.
From Mind Robotics's careers page, first listed on Rolev.ai on October 20, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this QA Reviewer, Data Annotation role at Mind Robotics, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
- Data Quality Analyst IISparksoft · Remote/Hybrid if local to Maryland
- Data Quality AnalystFigure · San Jose, CA
- Project Perseus | Data Quality Analyst - Italian Speakers (Human-in-the-Loop AI)Welo Global · California
- Data Quality ProfessionalHarbor · Remote (US)
- Data Quality AnalystCollabera · Plano, TX
- Project Perseus | Data Quality Analyst - French Speakers (Human-in-the-Loop AI)Welo Global · California
Common questions
Where is the QA Reviewer, Data Annotation job at Mind Robotics located?
This QA Reviewer, Data Annotation position at Mind Robotics is located in Palo Alto, CA (On-site). Always check Mind Robotics's application page for specific state eligibility or relocation policies.
What qualifications are required for QA Reviewer, Data Annotation at Mind Robotics?
For the QA Reviewer, Data Annotation role, Mind Robotics highlights 2+ years of relevant experience; experience with data annotation QA, inter-annotator agreement metrics, root-cause analysis. Rolev.ai can score your existing resume against these requirements and show any skill gaps before you apply.
How do I apply for the QA Reviewer, Data Annotation position at Mind Robotics?
This listing links directly to Mind Robotics's Ashby application page. You can apply directly on Mind Robotics's site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the Ashby application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.