AI Evaluation Engineer

What You’ll Do

• Engage in requirements and project meetings to fully understand goals and deliverables
• Review and analyze project requirements to pinpoint gaps and ensure they are suitable for creating test cases
• Design and maintain automated tests using Java or Python for our omnichannel solutions
• Employ automated testing tools for RESTful services connected to marketplace integrations
• Identify marketplace-specific use cases, performing manual tests when necessary, while progressing toward automation
• Develop automated acceptance and unit tests within an agile environment
• Utilize Jenkins and other CI tools for automation of development, build, deployment, and testing workflows
• Collaborate closely with product owners as part of a Scrum team to clarify requirements
• Examine test results from a technical perspective and provide detailed feedback to the development team
• Assist in troubleshooting production issues through coordinated testing and support efforts
• Create essential QA documentation, including test plans, scripts, strategies, and requirement traceability matrices

Nitty Gritty (What You’ll Need)

• Four-year degree in Computer Science/Engineering preferred
• 2+ years experience in software quality testing
• 2+ years of Agile Experience
• 2 years Python Experience preferred
• Experience in integration platforms preferred
• Thorough understanding of the Software Development Life Cycle (SDLC), encompassing requirements gathering, design, and testing, with hands-on experience in modern testing methodologies and tools
• Proficient in working with JSON and XML message formats
• Familiarity with Atlassian products such as JIRA and Confluence
• Experience working in agile environments and using continuous integration tools such as GitHub
• Solid knowledge of relational databases, with the ability to write MySQL queries to validate test results
• Practical exposure to RESTful automation tools
• Competence in at least one object-oriented programming language; scripting skills are an added advantage
• Capable of working independently or collaboratively in a fast-paced, dynamic environment under tight deadlines
• Strong analytical and organizational abilities, with aptitude for handling multiple projects simultaneously
• Demonstrates initiative, accountability, and ownership of projects and quality assurance activities

Perks

• Be part of an energetic team that is serious about delivering software to customers and cultivating our culture. We work awfully hard and are having a blast doing it. This team believes that what we are doing is a game-changer in the industry
• Coffee bar with cold brew on tap and a full time barista
• Standing desk (if you’re into that sort of thing)
• Corporate events including food trucks, Top Golf and other shenanigans
• Corporate office with co-working spaces, ping-pong tables, corn-hole boards, and Avalon around the corner
• Benefits package including health care, paid time off, life insurance, 401k plan (with match), and gym reimbursement
• Be part of a team recognized 6 years running as a USA Today Workplace