About this role
In this hourly, remote contractor role, you will work as a Punjabi Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across Punjabi AI training projects. You will review AI-generated Punjabi content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards.
You will assess work for accuracy, fluency, grammar, spelling, tone, cultural appropriateness, meaning preservation, instruction-following, formatting, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong Punjabi and English skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote teams.
This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your Punjabi quality leadership will directly help improve the world’s premier AI models by ensuring that Punjabi training data is natural, accurate, culturally appropriate, well-documented, and aligned with client expectations.
Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter.
Requirements
- Bachelor’s or Master’s degree in Mathematics
- Native or near-native Punjabi proficiency with strong reading and writing skills.
- Strong grasp of the English language to follow project guidelines, communicate with teams, and provide clear feedback in English.
- 3+ years of professional experience in Punjabi writing, editing, translation, localization, content QA, AI training, education, annotation, or related language-review workflows.
- Strong understanding of Punjabi grammar, spelling conventions, punctuation, tone, register, dialect variation, and cultural context.
- Comfortable handling Gurmukhi and/or Shahmukhi script requirements. Candidates should clearly specify which script(s) they can read and write.
- Ability to evaluate Punjabi content against detailed rubrics and identify issues such as mistranslation, literal phrasing, unnatural tone, hallucinated claims, ambiguity, or inconsistent terminology.
- Experience leading or supporting remote teams of trainers, annotators, reviewers, editors, or QAs is strongly preferred.
- Comfortable working in fast-moving remote environments using tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
- Highly detail-oriented and organized, with the ability to maintain style guides, FAQs, trackers, onboarding materials, honeypots, and other quality documentation.
- Experience with AI training, data annotation, large language models, prompt/response evaluation, or rubric-based LLM QA is a strong plus.
Responsibilities
- Quality monitoring: Spot-check Punjabi items, identify quality issues, provide ongoing feedback through DMs, and escalate recurring or critical issues.
- Trainer and QA communication: Update trainers and QAs on Discord about new item guidelines, project changes, workflow updates, and quality expectations.
- Question handling: Respond to trainer/QA questions clearly and promptly, especially around Punjabi wording, register, translation fidelity, cultural context, dialect variation, Gurmukhi/Shahmukhi script requirements, and edge cases.
- Trainer/QA activation management: DM contributors who are inactive or not working, encourage activation, track follow-ups, and flag availability issues when needed.
- Documentation: Create and maintain Punjabi project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, and onboarding materials.
- Onboarding and training: Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and Punjabi-specific style/script requirements.
- Quality alignment: Ensure all trainers and QAs apply Punjabi language guidelines consistently and understand updates as projects evolve.
- Process improvement: Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for Punjabi-language projects.
Skills
- Punjabi Quality Assurance
- Punjabi
- LLM Evaluation
- Translation Quality Review
- Style Guides
- AI Training
- Documentation
- Trainer Feedback
- English
- Localization QA
Additional skills
- Punjabi Language
- Native Punjabi Fluency
- Gurmukhi Script
- Shahmukhi Script
- Punjabi Grammar
- Punjabi Proofreading
- Punjabi Copyediting
- Punjabi Writing
- Punjabi Translation
- English Proficiency
- Localization
- Transcreation
- Terminology Management
- Style Guide Development
- Linguistic QA
- Content Quality Assurance (QA)
- Rubric-Based Evaluation
- Error Analysis
- Cultural Localization
- Dialect Awareness
- Remote Team Leadership
- Team Management
- Reviewer Training
- Onboarding Documentation
- Data Annotation
- AI Training Data
- LLM Evaluation
- Prompt Evaluation
- Google Docs
- Google Sheets
