Senior Python Developer (AI Evaluation & Benchmarking)
- Pay
- $80 – $100 per hour
- Location
- Texas City, TX (Remote)
- Listed
- 3 days ago
About the role
This opportunity is ideal for senior software engineers with strong Python expertise who enjoy writing high-quality code, reviewing technical solutions, and working on AI-related projects.
What You'll Do
- Design and develop coding benchmarks used to evaluate frontier AI models.
- Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.Build and maintain scalable data pipelines that support AI evaluation workflows.
- Create structured programming scenarios to test reasoning, debugging, and code quality.
- Work with large codebases and multi-language software environments.
- Collaborate with teams focused on improving how AI models understand, generate, and evaluate software.
- Write clean, maintainable, and well-tested Python code following software engineering best practices.
Requirements
- 4+ years of professional software engineering experience (required).
- Expert-level proficiency in Python.
- Experience working at a high-growth technology company or top-tier software organization.
- Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar.
- Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit.
- Strong understanding of software engineering best practices, debugging, and code quality.
- Excellent analytical and problem-solving skills.
Nice to Haves
- Experience with AI/ML evaluation, model benchmarking, or Generative AI.
- Background in security engineering.
- Significant contributions to open-source software projects.
- Experience working with large-scale distributed systems or enterprise software platforms.
Additional Information
- Fully remote contract opportunity.
- Compensation ranges from $80-$100 USD per hour.
- Expected workload is 10-39 hours per week, depending on project needs.
- Weekly payments for approved work completed during the previous week.
- Work volume may fluctuate throughout the duration of the engagement.
Hiring Process
- Submit your proposal.
- Complete a short qualification form provided by the client.
- Qualified candidates will receive an Upwork contract offer and onboarding instructions.
- After accepting the contract, candidates will gain access to the client's evaluation.
- Candidates who successfully pass the evaluation will be invited to a technical interview with the client.
About the Company
An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platform that enables organizations to build intelligent applications through high-quality human feedback, AI evaluation, and model alignment.
The selected consultants will contribute to AI research by designing programming benchmarks, evaluating AI-generated code, and helping improve the performance, reasoning, and reliability of frontier AI models. This is an excellent opportunity for experienced software engineers who enjoy solving complex technical problems while contributing to the future of Generative AI.
From Lifted, an Upwork Company™'s careers page, first listed on Rolev.ai on November 6, 2026. Rolev.ai is not the employer.
How Rolev.ai helps with this application
Rolev.ai is a job search and application tool for US job seekers. For this Senior Python Developer (AI Evaluation & Benchmarking) role at Lifted, an Upwork Company™, it shows how your resume fits, tailors your resume to the posting, and prepares the application for you to review.
See how you fit
Openings from employer career sites are ranked against your whole resume—and searchable inside Claude, ChatGPT, and Cursor via Rolev.ai MCP.
Tailor without inventing
Every change to your resume is checked against your original. New experience goes in only with your yes—zero fabricated claims.
Draft the full kit
Tailored and Full Match resumes, role-specific cover letters, and answers to employer screening questions are prepared in seconds.
1-Click Extension Autofill
The Chrome extension fills the employer's Greenhouse, Workday, Lever, or Ashby form in 1 click. You review it and press Submit.
Similar roles
- Senior Python Software EngineerOld Mission Capital · New York, NY
- Senior Python/Flask+React Fullstack Engineer - Remote, Latin AmericaBluelight Consulting · Mexicali, Baja California, Mexico
- Senior Python Software Engineer (Production)Anduril · Waltham, MA
- Senior Python Engineer - Pre-trade (Gas & Power Industry)Talan · Houston, TX
- Senior Python DeveloperNT Concepts · Chantilly, VA
- Senior Python DeveloperEvolver · Palo Alto, CA
Common questions
What is the salary for the Senior Python Developer (AI Evaluation & Benchmarking) role at Lifted, an Upwork Company™?
The Senior Python Developer (AI Evaluation & Benchmarking) posting at Lifted, an Upwork Company™ states compensation of $80 – $100 per hour. Final pay may depend on location, experience, and interview evaluation on Lifted, an Upwork Company™'s official career site.
Where is the Senior Python Developer (AI Evaluation & Benchmarking) job at Lifted, an Upwork Company™ located?
Yes, this Senior Python Developer (AI Evaluation & Benchmarking) opening at Lifted, an Upwork Company™ is listed as Texas City, TX (Remote). Always check Lifted, an Upwork Company™'s application page for specific state eligibility or relocation policies.
How do I apply for the Senior Python Developer (AI Evaluation & Benchmarking) position at Lifted, an Upwork Company™?
This listing links directly to Lifted, an Upwork Company™'s SmartRecruiters application page. You can apply directly on Lifted, an Upwork Company™'s site, or use Rolev.ai to check your resume fit, generate a zero-hallucination tailored resume and cover letter for this posting, and autofill the SmartRecruiters application form in 1 click with the Rolev.ai Chrome extension. You always review the form and press Submit yourself.