Coding Expert (US & International)

The future of AI — whether in training or evaluation, classical ML or agentic workflows — starts with high-quality data.At HumanSignal, we’re building the platform that powers the creation, curation, and evaluation of that data. From fine-tuning foundation models to validating agent behaviors in production, our tools are used by leading AI teams to ensure models are grounded in real-world signal, not noise.Our open-source product, Label Studio, has become the de facto standard for labeling and evaluating data across modalities — from text and images to time series and agents-in-environments. With over 250,000 users and hundreds of millions of labeled samples, it’s the most widely adopted OSS solution for teams working on building AI systems. Label Studio Enterprise builds on that traction with the security, collaboration, and scalability features needed to support mission-critical AI pipelines — powering everything from model training datasets to eval test sets to continuous feedback loops.We started before foundation models were mainstream, and we’re doubling down now that AI is eating the world. If you're excited to help leading AI teams build smarter, more accurate systems — we’d love to talk.Software Engineering Expert - Code Annotation & Evaluation SpecialistAbout the RoleHumanSignal is seeking highly qualified software engineering and computer science experts to contribute to cutting-edge AI development projects. This role involves evaluating, annotating, and validating code across multiple programming languages and domains to improve AI model performance in software development and problem-solving.CompensationUp to $110 USD/hourbased on qualifications and project complexityRequired QualificationsEducationMaster's degree requiredin a computer science or software engineering-related fieldPhD strongly preferredin:Computer ScienceSoftware EngineeringComputer EngineeringComputational ScienceInformation ScienceOr closely related technical disciplinesDegree Field RequirementsCandidates must hold degrees directly in computer science, software engineering, or computationally-intensive fields. Acceptable programs include:Computer ScienceSoftware EngineeringComputer EngineeringComputational ScienceInformation Technology (with strong programming foundation)Data Science/Machine LearningElectrical Engineering (with software emphasis)ResponsibilitiesReview and evaluate code for correctness, efficiency, and best practicesAnnotate code logic, algorithms, and implementation approachesValidate AI-generated code across various programming languages and frameworksIdentify bugs, security vulnerabilities, and performance issuesProvide detailed feedback on code quality, structure, and documentationWork with problems spanning algorithms, data structures, system design, and software architectureQualificationsDeep understanding of software engineering principles across multiple domainsProficiency in multiple programming languagesStrong analytical and problem-solving skillsExcellent attention to detail and code quality standardsAbility to clearly articulate technical reasoning and trade-offsExperience with version control, testing frameworks, and development toolsFamiliarity with software development methodologiesAbility to work independently and meet deadlinesWork DetailsFlexible, project-based work- work on your own scheduleRemote position - work from anywhereVariable hours based on project availability and your capacityOngoing training and calibration providedQuality-focused environment with performance feedbackIdeal Candidate ProfileActive software engineers, researchers, professors, or recent graduates in CS/engineering fieldsStrong GitHub/portfolio or demonstrated technical expertiseExperience in software development, research, or industry applicationsPassion for advancing AI capabilities in software development domainsHow to ApplyInterested candidates should be prepared to:Submit CV/resume highlighting technical qualificationsProvide proof of advanced degree(s)Complete a brief coding assessmentParticipate in a qualification reviewOriginally posted on Himalayas