U
PDF Annotation & Transcription Experts - Bengali
Unknown
38d ago
No Phone RequiredData-entryRemote, USjobspy_indeed
remoteindeed
Job Description
PDF Annotation \& Transcription Experts \- Bengali is a remote Bengali specialist track for evaluating bengali annotation outputs against native\-speaker standards. Reviewers spot fluency, register, and cultural\-context errors that automated checks miss, and write structured rationale that the modeling team can act on in the next training cycle.
**Why this role matters**
-------------------------
Multilingual model quality depends on reviewers who can read Bengali the way a native speaker does. AuraOne uses these reviewers to set the bar for tone, formality, and cultural register before a model ever ships to Bengali users.
**Responsibilities**
--------------------
* Evaluate Bengali model responses for fluency, accuracy, register, and cultural fit for PDF Annotation \& Transcription Experts \- Bengali assignments.
* Compare paired bengali annotation outputs and pick the stronger response with a written rationale.
* Flag hallucinations, code\-switching errors, and formality mismatches with task\-specific severity tags.
* Capture native\-speaker edits that demonstrate the correct phrasing alongside each issue.
* Calibrate against the AuraOne Bengali rubric in weekly reviewer\-quality cycles.
* Surface ambiguous prompts back to the program team so the rubric can be sharpened.
* Maintain reviewer notes that document tricky idioms, regionalisms, and emerging usage.
**Qualifications**
------------------
* Native or near\-native Bengali fluency with strong written\-English ability for PDF Annotation \& Transcription Experts \- Bengali work.
* Demonstrable experience editing, translating, or evaluating Bengali content.
* Comfort applying multi\-page rubrics consistently across long evaluation batches.
* Clear written reasoning that names the issue and the standard being applied.
* Reliable async availability for at least 10 hours per week.
* Prior model\-evaluation, annotation, or human\-rater experience is a plus.
**Example tasks**
-----------------
* Score a pair of Bengali responses to a customer\-support prompt and pick the better one with a 1\-2 sentence rationale.
* Flag formality mismatches in bengali annotation outputs (T/V usage, honorifics, regional register).
* Rewrite a model's Bengali response so it reads naturally and tag the original error category.
* Audit a 50\-row evaluation batch for rubric consistency and surface drift back to the program lead.
**Nice to have**
----------------
* Background in Bengali linguistics, journalism, or translation studies.
* Experience with TMS tools, MQM error taxonomies, or other structured QA frameworks.
* Familiarity with LLM evaluation rubrics and inter\-rater agreement workflows.
**Skills**
----------
* Multilingual evaluation
* Native\-speaker review
* Rubric application
* LLM output evaluation
* Bengali annotation
**Work model**
--------------
Remote — US\-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
