TikTok Shop - Model Quality Assurance Program Manager

TikTok

  • Singapore
  • Permanent
  • Full-time
  • 14 days ago
E-commerce's Governance and Experience (GNE) is a global team responsible for ensuring our marketplace is safe and trustworthy for not only our users, but also sellers and creators. We value user satisfaction and work on policies, rules and systems to ensure quality. Service and Support Centre (SSC) is part of the GNE organization. Our mission is to provide world-class service and experience for customers, sellers and creators. We are looking for a Model Quality Assurance Program Manager to perform model quality analysis, to improve the automation modeling capability.Responsibilities:
- Own automation QA for Global AAD (Aftersales, Arbitration, Dispute scenarios) by analyzing automation model data performance, and establishing automation strategy with innovative thoughts.
- Set the annotation process and target for vendors to ensure productivity and quality.
- Provide coaching and training to help vendors to continuously meet the target setting.
- Collaborate with the algorithm team and product team to improve automation modeling and feature capability.
- Investigate fatal errors, hallucinations, and SOP misalignments in complex high-risk flows, ensuring strategies deployed are aligned with policy, operation, and algorithm stakeholders on improvement loops.
- Contribute to the evaluation framework development to produce quality QA results representative of current business line's performance.Qualifications:Minimum Qualifications
- Bachelor's degree or above.
- 1+ years of experience in Large Language Models (LLMs), Quality Assurance, or roles related to user experience evaluation and optimization.
- Expertise in project design, data analysis, communication skills, driving for results and managing changes.
- Strengths in problem shooting, issue-resolution, ability to work in a deadline-driven work environment, attention to detail, and ability to multi-task.Preferred Qualifications
- Additional certifications or advanced degrees related to automation or relevant fields.

TikTok