← Back to all jobs
Y

QA Software Test Engineer Code Review - Remote

YO IT CONSULTING

9h ago

0DevUSjobspy_indeed
remoteindeed

Job Description

**hiring experienced Software Engineers** to support high\-impact research collaborations with leading AI labs. Freelancers will contribute to building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding\-related interactions. This is a unique opportunity to apply your engineering expertise toward shaping the next generation of intelligent systems. **About the Project** This evaluation dataset is code question and answer data. This data is designed to assess natural\-language reasoning, explanation quality, and technical judgment in coding\-related interactions, rather than executable correctness. Tasks are structured as chat\-pasteable prompts that reflect realistic developer questions and include all necessary context inline (e.g., code snippets, error messages, logs, or requirements) **Key Responsibilities** * Craft realistic developer prompts across multiple categories (code review, debugging, error diagnosis, configuration, and more) * Source and adapt content from real PRs to create authentic scenarios * Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality **Ideal Qualifications** * 2\+ years of experience in software engineering, technical research, or educational content development * Degree in Software Engineering, Computer Science, or a related field (Bachelor’s minimum; advanced degree preferred) * Strong proficiency in languages like Python, JavaScript, Java, or C\+\+ * Experience with debugging, testing, and validating code * Comfortable with technical writing and attention to detail **Project Timeline** * **Start Date:** Immediate * **Duration:** 1\-2 months * **Commitment:** Part\-time (15–25 hours/week, with flexibility up to 40 hours/week) **Application \& Onboarding Process** * Upload your resume * AI interview: A short, 15\-minute conversational session to understand your background, experience, and interest in the role * Follow\-up communication within a few days with next steps and onboarding details **Apply today** and leverage your software engineering expertise to help build the future of AI\-driven systems! We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request **Contract and Payment Terms** * You will be engaged as an independent contractor. * This is a fully remote role that can be completed on your own schedule. * Projects can be extended, shortened, or concluded early depending on needs and performance.