Remote | AI Scenario Quality Review & Technical QA Lead -- $95-$125/hour
15 hours ago
New York
Job Description We are sharing a specialised part-time consulting opportunity for professionals experienced in quality control, technical review, rubric-based evaluation, scenario auditing, structured feedback, and complex workflow assessment. This role supports current and upcoming remote consulting opportunities focused on structured AI training scenario review, simulated environment auditing, quality assurance, rubric-based scoring, technical content validation, and high-quality project execution. Selected professionals will apply strong analytical judgment and attention to detail to evaluate complex digital scenarios, identify inconsistencies, document issues clearly, and support rigorous quality standards across scenario-based review workflows. Key Responsibilities Professionals in this role may contribute to: Scenario Auditing & Quality Review • Review complex simulated environments, personas, digital workspaces, and scenario-based tasks for realism, logic, and completeness, • Evaluate tasks involving workplace-style tools, files, communications, and multi-step digital workflows, • Assess whether scenarios are properly structured, internally consistent, technically sound, and appropriately challenging, • Apply detailed grading rubrics to score scenario quality consistently and objectively, • Review task materials for reasoning difficulty, feasibility, prioritization demands, and alignment with evaluation criteria, • Identify technical flaws such as invalid JSON structures, incomplete metadata, inconsistent field logic, or broken workflow dependencies, • Provide clear, constructive, and actionable written feedback to scenario creators, • Document review outcomes, scores, issue logs, and improvement recommendations in structured review systems, • Support quality calibration by maintaining consistent standards across multiple scenario types Strong candidates may have: • 2+ years of professional experience in QA, editing, auditing, technical review, compliance review, peer review, scenario evaluation, or complex content assessment, • Strong ability to learn and apply detailed grading rubrics with consistency, • Excellent attention to detail and ability to catch inconsistencies, edge cases, logical gaps, and technical issues, • Comfort reviewing structured content, simulated workflows, digital environments, and multi-step task designs, • Ability to provide constructive, specific, and well-organized feedback, • An undergraduate degree is helpful, • Backgrounds in communications, English, technical writing, quality assurance, computer science, data analysis, operations, business, law, education, or related fields may be relevant, • Experience as a senior editor, QA tester, technical reviewer, compliance auditor, peer reviewer, data analyst, technical PM, process reviewer, or systems-focused professional, • Familiarity with JSON, Airtable, Jira, Asana, SQL, Python, AI platforms, structured data review, or technical QA workflows, • Experience reviewing complex written content, technical documentation, simulated workflows, data structures, task specs, or multi-stakeholder processes, • Strong systems thinking and ability to understand how professional workflows should function logically, • Apply quality control and analytical review expertise to structured remote project work, • Contribute to high-quality scenario auditing, rubric-based evaluation, and technical QA workflows, • Work on assignments aligned with your review, editing, QA, or systems-thinking background, • Use your judgment in a focused, detail-oriented review environment, • Independent contractor role, • Fully remote with flexible scheduling, • Extended weekly commitment may be available depending on project needs, • Competitive rates between $95–$125 per hour depending on expertise, • Weekly payments via Stripe or Wise, • Projects may be extended, shortened, or adjusted depending on scope and performance This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: .