Senior Software Engineer In Test (Full-Stack/Python)

Mindrift connects specialized professionals with project-based opportunities to test, evaluate, and enhance AI systems for leading technology companies. This is a project-based engagement rather than permanent employment, offering flexibility for experienced developers seeking challenging work. As a Senior Software Engineer in Test (Full-Stack/Python), you will create sophisticated coding test cases that rigorously challenge AI coding systems. Your primary responsibility involves developing realistic, comprehensive test scenarios that push AI capabilities to their limits through complex reasoning tasks and edge case validation. You will review and refine coding tasks based on production codebases with realistic scope and requirements, write comprehensive functional tests that validate actual end-to-end behavior, and craft "fair but hard" challenges where AI systems must work through scattered information across files and external sources. Additionally, you will analyze AI failures to understand model limitations versus strengths and iterate based on feedback from expert QA reviewers.