Training & Quality Specialist (Prompt Engineering), AI Data Service and Operations (ADSO) - Data Annotation Lab

TikTok

  • Singapore
  • Permanent
  • Full-time
  • 2 months ago
The Al Data Service and Operations (ADSO) team is responsible for providing safety and non-safety data annotation services and search operation services for all of the company's international products, which can also help international products build their own data ecological security.We are seeking a Training & Quality Specialist to directly support our Prompt Engineering team, which is responsible for crafting and optimizing prompts that guide Al models toward high-quality outputs. This role is critical in maintaining the consistency, accuracy, and excellence of prompt writing through targeted quality auditing, data-driven insights, and impactful training initiatives. As a key partner to the Prompt Writers, you will be responsible for evaluating written outputs for alignment with internal guidelines, conducting root-cause analysis to identify trends or gaps, and developing responsive training materials to address areas for improvement. You will also play a vital role in onboarding new writers, driving policy comprehension, and promoting a strong quality culture across the team.Responsibilities
  • Audit Prompt Writer outputs to ensure alignment with complex policy guidelines, stylistic standards, and quality benchmarks, delivering clear feedback and actionable insights.
  • Analyze performance data and error trends using both quantitative and qualitative methods to proactively identify quality gaps and implement corrective strategies.
  • Partner with Prompt Writers, team leads and cross-functional teams, to maintain a consistent understanding of quality expectations and ensure calibration across teams.
  • Develop, deliver, and maintain structured training programs including onboarding, policy refreshers, and upskilling modules tailored to Prompt Engineering needs.
  • Regularly review and update training content and documentation to reflect evolving policies, best practices, and model capabilities.
  • Support experimentation efforts by advising on quality criteria for prompt iterations and assisting with the documentation of prompting strategies and results.
  • Collaborate cross-functionally with Policy, Product, and Engineering teams to address quality-related concerns and support continuous improvement initiatives.
  • Maintain high documentation standards around audit records, training progress, and improvement plans to ensure traceability and accountability.
  • Contribute to ad hoc quality and governance projects to elevate content integrity and team performance.
  • Please note that this position involves exposure to sensitive content, including but not limited to vulgar content, violence, pornography, and fake news.
Qualifications:Minimum Qualifications
  • ⁠ ⁠Bachelor's degree in Computer Science, Linguistics, or a related field
  • ⁠ ⁠2 years of experience in quality assurance, training, editorial review, or a related field; prior experience in supporting content moderation, Al, or technical writing teams is a plus.
  • ⁠ ⁠Strong command of English with an exceptional eye for detail, clarity, and linguistic consistency.
  • ⁠ ⁠Demonstrated ability to interpret and enforce complex guidelines or policies in writing-focused workflows.
  • ⁠ ⁠Analytical thinker with experience evaluating qualitative content and using data to inform process improvements.
  • ⁠ ⁠Experience designing and delivering interactive, engaging training materials and sessions.
  • ⁠ ⁠Demonstrates a high level of self-motivation, solution-centric thinking, strong ability to multi-task, prioritize and meet strict deadlines in a fast-paced, dynamic, and highly collaborative environment.

TikTok