Portuguese AI QA Content Specialist
hace 14 horas
Valencia
As a Portuguese QA Content Specialist, you will play a key role in ensuring the quality, consistency, and accuracy of data used to train and evaluate Large Language Models (LLMs) and multimodal AI systems. Your primary focus will be on reviewing annotations, gradings, and AI-generated outputs. You will assess whether annotations follow project guidelines, meet quality standards, and accurately reflect expected model behavior across different modalities. This role requires strong attention to detail, analytical thinking, and the ability to apply complex guidelines consistently. Responsibilities • Review and quality-check annotations, gradings, and evaluations produced for LLM and multimodal projects (text, image, audio, and/or video)., • Validate that annotations and ratings adhere to project guidelines, rubrics, and quality standards., • Identify errors, inconsistencies, ambiguities, and potential biases in annotated data and AI-generated outputs., • Provide clear, actionable feedback to annotators to improve accuracy and consistency., • Flag systematic issues and contribute insights to improve guidelines, workflows, and QA processes., • Collaborate closely with the Quality Management (QM) and project teams to implement QA strategies and calibration efforts., • Support quality audits, spot checks, and escalation of complex edge cases when required., • Conduct production support as required and perform final data corrections to ensure data quality., • Support Quality Management (QM) initiatives, including the development, refinement, and maintenance of project guidelines and processes. Qualifications • Experience in quality assurance, content review, or data annotation for AI/ML projects., • Familiarity with LLMs and multimodal AI systems (text, image, audio, video) is a strong plus., • Experience reviewing gradings, ratings, or structured annotations is highly desirable., • Strong analytical skills and ability to apply detailed guidelines consistently., • Excellent written communication skills for providing clear, constructive feedback., • High attention to detail and commitment to quality., • Ability to work independently while collaborating effectively within a distributed team., • Ability to manage multiple projects simultaneously, each with distinct guidelines, workflows, and quality standards., • Demonstrated flexibility in taking on different tasks as the role and organizational needs evolve., • Ability to remain composed and effective in fast-paced environments, including adapting to last-minute changes in daily priorities., • Ability to prioritize pilot projects, effectively managing the unique challenges, ambiguity, and frequent changes inherent to pilot initiatives. Nice to have: • Background in linguistics, content analysis, digital moderation, or AI evaluation., • Previous experience working with annotation platforms or QA tools., • Content writing or prompt authoring experience (helpful, but not required). Why Join Us? If you are a detail-oriented QA professional interested in contributing to the development of cutting-edge AI systems, this role offers the opportunity to work on real-world LLM and multimodal projects, directly impacting model quality and reliability. In compliance with the General Disability Law, the submission of the corresponding disability certificate will be valued. About Centific Centific expertly engineers platforms and curates multimodal, multilingual data to empower the ‘Magnificent Seven’ and enterprise clients with safe, scalable Artificial Intelligence(AI) deployment. Our team includes over 150 PhDs and data scientists, along with more than 4,000 AI practitioners and engineers. We leverage an integrated ecosystem comprised of industry-leading partnerships, and 1.8 million vertical domain experts across 230 locales, to create high-quality pre-trained datasets, fine-tuned industry-specific Large Language Models(LLMs), and Retrieval-Augmented Generation (RAG) pipelines supported by vector databases. Our innovations can reduce Generative Artificial Intelligence(Gen AI) costs by up to 80% and bring Gen AI solutions to market 50% faster. Our mission is to bridge the gap between AI creators and industry leaders by bringing best practices in Generative AI to unicorn innovators and enterprise customers. We aim to help these organizations unlock significant business value by leveraging Generative AI at scale, ensuring they stay at the forefront of technological advancement and maintain a competitive edge in their respective markets. Applying to this job implies your agreement with: In compliance with the applicable data protection regulations (General Data Protection Regulation 679/2016), we at Centific, as data Controllers, inform you that the data collected will be processed to manage your application in the selection process. This processing is legitimized by the consent given upon submitting your application, and the data will be retained for a maximum of two years. You may exercise your rights of access, rectification, deletion, opposition, restriction of processing, and data portability by contacting Furthermore, if deemed necessary, you may file a complaint with the relevant supervisory authority. Your Authentic Self at Centific Centific is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. Centific is also committed to compliance with all fair employment practices regarding citizenship and immigration status.