← Back to all jobs
U

Simplified Chinese Legal AI Evaluation Specialist — Multiple-Choice QA Review

Unknown

69d ago

0$83k - $102kDevRemote, USjobspy_indeed
remoteindeed

Job Description

Simplified Chinese Legal AI Evaluation Specialist — Multiple\-Choice QA Review is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it. **Why this role matters** ------------------------- Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original. **Responsibilities** -------------------- * Review AI outputs against current legal review statutes, case law, or policy for Simplified Chinese Legal AI Evaluation Specialist — Multiple\-Choice QA Review assignments. * Verify citations, jurisdictions, and dates against authoritative sources. * Flag risky reasoning, missed exceptions, and policy\-adherence gaps with severity tags. * Capture the corrected analysis or memo paragraph so the modeling team can train on it. * Adjudicate disputed treatments against published authority or firm policy. * Maintain reviewer\-quality scores in inter\-rater calibration cycles. **Qualifications** ------------------ * Active or recent qualification in legal review or an adjacent practice for Simplified Chinese Legal AI Evaluation Specialist — Multiple\-Choice QA Review work. * Hands\-on experience drafting, reviewing, or advising on real matters. * Comfort applying multi\-page rubrics consistently across long batches. * Clear written reasoning that cites authority and names the rule being applied. * Reliable async availability for at least 10 hours per week. **Example tasks** ----------------- * Verify the citations in a model's legal review memo and flag any miscites with severity. * Grade a model's statutory reasoning on a complex fact pattern and rate the analysis. * Adjudicate a disputed treatment between two reviewers using current authority. * Audit a 25\-row batch for rubric consistency and report drift to the program lead. **Nice to have** ---------------- * Bar admission or legal\-equivalent credential in a relevant jurisdiction. * Prior experience reviewing AI\-assisted legal\-research or compliance tooling. * Bilingual experience for cross\-jurisdiction matters. **Skills** ---------- * Legal research * Citation review * Statutory analysis * Policy reasoning * Legal review **Work model** -------------- Remote — US\-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US. **Compensation** ---------------- $40–$49 / hr **Application process** ----------------------- Apply through AuraOne's specialist intake for role\-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.