Evaluator jobs in OxfordCreate job alerts

About Us: Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L. Ideal Background: This role is ideal for engineers who have worked at the frontier of AI — at companies like OpenAI, NVIDIA, Databricks, Palantir, Snowflake, or similar organizations pushing the boundaries of intelligent systems. We especially welcome graduates from leading programs such as Harvard, Columbia, Princeton, Yale, University of Pennsylvania, and comparable institutions — though exceptional experience and skill always take precedence over pedigree. Project Overview: As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS) — with particular emphasis on systems-level code, performance-critical applications, and infrastructure. You will evaluate and refine AI-generated code for efficiency, scalability, and reliability, and work with cross-functional teams to enhance enterprise-level AI-driven coding solutions. What Does a Typical Day Look Like? • Work on AI model training initiatives by curating code examples, building solutions, and correcting code in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS)., • Evaluate and refine AI-generated code with an emphasis on systems-level correctness, performance, and reliability., • Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks., • Build agents that can verify the quality of systems-level and infrastructure code and identify error patterns., • Hypothesize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them., • Design verification mechanisms that can automatically verify a solution to a software engineering task. Required Skills: • Several years of software engineering experience (3 years or more), • Strong expertise in systems programming, infrastructure, or backend development using languages like Python, C/C++, Rust, and Go., • Experience building and deploying scalable, production-grade software using modern languages and tools., • Deep understanding of software architecture, design, development, debugging, and code quality/review assessment., • Excellent oral and written communication skills for clear, structured evaluation rationales. Engagement Details: • Commitment: flexible engagement, minimum 10 hrs/week, up to 40 hrs/week, • Type: Contractor (no medical/paid leave), • Duration: 1 month (potential extensions based on performance and fit), • Location: Candidates must be based in the United States Evaluation Process: • The application process takes 15–30 minutes., • Completion of an AI video interview is required. Note: As part of assessments you will go through an AI video interview. After applying, you will receive an email with a login link. Please use that link to access the portal and complete your profile. Know amazing talent? Refer them at turing.com/referrals, and earn money from your network.

About Us: Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L. Ideal Background: This role is ideal for engineers who have worked at the frontier of AI — at companies like OpenAI, NVIDIA, Databricks, Palantir, Snowflake, or similar organizations pushing the boundaries of intelligent systems. We especially welcome graduates from leading programs such as Harvard, Columbia, Princeton, Yale, University of Pennsylvania, and comparable institutions — though exceptional experience and skill always take precedence over pedigree. Project Overview: As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS) — with particular emphasis on systems-level code, performance-critical applications, and infrastructure. You will evaluate and refine AI-generated code for efficiency, scalability, and reliability, and work with cross-functional teams to enhance enterprise-level AI-driven coding solutions. What Does a Typical Day Look Like? • Work on AI model training initiatives by curating code examples, building solutions, and correcting code in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS)., • Evaluate and refine AI-generated code with an emphasis on systems-level correctness, performance, and reliability., • Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks., • Build agents that can verify the quality of systems-level and infrastructure code and identify error patterns., • Hypothesize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them., • Design verification mechanisms that can automatically verify a solution to a software engineering task. Required Skills: • Several years of software engineering experience (3 years or more), • Strong expertise in systems programming, infrastructure, or backend development using languages like Python, C/C++, Rust, and Go., • Experience building and deploying scalable, production-grade software using modern languages and tools., • Deep understanding of software architecture, design, development, debugging, and code quality/review assessment., • Excellent oral and written communication skills for clear, structured evaluation rationales. Engagement Details: • Commitment: flexible engagement, minimum 10 hrs/week, up to 40 hrs/week, • Type: Contractor (no medical/paid leave), • Duration: 1 month (potential extensions based on performance and fit), • Location: Candidates must be based in the United States Evaluation Process: • The application process takes 15–30 minutes., • Completion of an AI video interview is required. Note: As part of assessments you will go through an AI video interview. After applying, you will receive an email with a login link. Please use that link to access the portal and complete your profile. Know amazing talent? Refer them at ___, and earn money from your network.

About Us: Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L. Ideal Background: This role is ideal for engineers who have built production systems at companies like Google, Microsoft, Apple, Amazon, Meta, or similar high-scale engineering organizations. We especially welcome graduates from top computer science programs such as Stanford, MIT, Carnegie Mellon, UC Berkeley, Georgia Tech, and comparable institutions — though exceptional experience and skill always take precedence over pedigree. Project Overview: As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections — with a primary focus on Python across backend services, data pipelines, and ML infrastructure, alongside JavaScript (including ReactJS), C/C++, Java, Rust, and Go. You will evaluate and refine AI-generated code for efficiency, scalability, and reliability, and work with cross-functional teams to enhance enterprise-level AI-driven coding solutions. What Does a Typical Day Look Like? • Work on AI model training initiatives by curating code examples, building solutions, and correcting code — primarily in Python, with additional work in JavaScript (including ReactJS), C/C++, Java, Rust, and Go., • Evaluate and refine AI-generated code to ensure that it is efficient, scalable, and reliable., • Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks., • Build agents and automated verification tools in Python that can verify the quality of code and identify error patterns., • Hypothesize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them., • Design verification mechanisms that can automatically verify a solution to a software engineering task. Required Skills: • Several years of software engineering experience (3 years or more), • Strong expertise in Python with deep knowledge of frameworks, tooling, and best practices for building production-grade software., • Experience building full-stack applications and deploying scalable software using modern languages and tools., • Deep understanding of software architecture, design, development, debugging, and code quality/review assessment., • Excellent oral and written communication skills for clear, structured evaluation rationales. Engagement Details: • Commitment: flexible engagement, minimum 10 hrs/week, up to 40 hrs/week, • Type: Contractor (no medical/paid leave), • Duration: 1 month (potential extensions based on performance and fit), • Location: Candidates must be based in the United States Evaluation Process: • The application process takes 15–30 minutes., • Completion of an AI video interview is required. Note: As part of assessments you will go through an AI video interview. After applying, you will receive an email with a login link. Please use that link to access the portal and complete your profile. Know amazing talent? Refer them at ___, and earn money from your network.

A leading AI consultancy firm is looking for a Bilingual AI Response Evaluator to ensure the quality of AI-generated content in Hebrew and English.

A prominent healthcare regulation body in the UK is seeking a Specialist Applications Associate to evaluate portfolios for specialist registration.Applicants must be registered specialists with a current license to practice, having had patient contact in the last two years.This role offers flexibili

A leading AI talent connector is seeking Education Teachers for a remote position to design educational questions and evaluate AI-generated content.Candidates should have over 4 years of experience in post-secondary education and will work independently with AI teams.The role offers competitive hour

A leading educational organization is seeking a Mathematics PhD for a remote hourly contract position.Responsibilities include solving advanced mathematics problems, reviewing AI-generated solutions, and providing feedback to improve mathematical reasoning.Candidates should have a recent PhD in Math

A leading AI talent firm is seeking an AI Model Evaluation Specialist in Greater London.This role involves evaluating AI-generated responses for accuracy, writing domain-specific prompts, and requiring a Master’s degree in Health.Candidates must possess professional experience in the field and str

A leading customer experience agency is looking for Freelance Luxury Brand Evaluators.

A creative and technical talent connection firm is seeking an AI Evaluation Specialist for a short-term project in the UK.This role involves evaluating the accuracy of AI-generated content, collaborating with subject matter experts, and providing structured feedback to enhance AI model performance.T

A tech company specializing in AI training is seeking a Biology Instructor to join their team.This role focuses on training AI models by evaluating their responses to complex biology questions and improving their quality.Candidates should have expert knowledge in biology, with preferences for those

A leading AI talent firm in Greater London is seeking an AI Model Evaluation Specialist to join their team on a contract basis.The role involves writing prompts, evaluating the accuracy of AI-generated responses, and providing justifications for evaluations.The ideal candidate will hold a Master's d

A leading data annotation provider in the United Kingdom is seeking an experienced Associate Editor to evaluate and enhance AI chatbots.The successful candidate will possess expert writing and editing abilities, ensuring high-quality content development.The role allows for flexible scheduling with a

A leading AI recruitment firm in Greater London seeks an AI Model Evaluation Specialist to evaluate AI-generated responses for accuracy and usefulness.Candidates must have a Master's degree in Legal or a relevant field and possess strong written communication skills.The role involves writing prompts

A tech company focused on AI development is seeking an Investment Risk Analyst to work remotely.Ideal candidates will have a Master’s or PhD in finance and expertise in financial reasoning.This role allows you to set your own schedule while reviewing AI Assistant outputs and providing structured f

A leading AI research firm in Greater London is looking for a part-time Legal Evaluator.

A tech firm specializing in AI is seeking an annotator to assist in evaluation tasks.As an annotator, you will review and classify content as per guidelines while engaging in advanced AI projects.This remote, part-time role is ideal for those pursuing higher education and requires advanced Italian a

A leading AI research talent firm is looking for an AI Model Evaluator in Greater London.

A healthcare assessment company in West Yorkshire is seeking a Nurse Assessor to conduct evaluations and support DWP decision-making.This role offers a competitive basic salary, flexible working hours, and extensive training designed for those transitioning from hands-on care roles.Candidates must b

Join the global community that enhances and elevates the experience of the most prestigious luxury brands in the world! CXG, a leading customer experience agency servicing premium and luxury brands, is looking for mission-based Customer Experience Evaluators who are existing luxury brand customers.

A growing AI training company in the United Kingdom is seeking a UI/UX Designer to enhance AI models by reviewing and critiquing design outputs.In this role, you will use your design expertise to assess and improve AI understanding of aesthetics, usability, and quality.This remote position offers fl

A leading AI technology firm is seeking experienced software engineers to evaluate frontier AI models.This fully remote position allows you to work flexible hours while assessing AI-generated code for bugs and reliability.Candidates should have over 3 years of engineering experience and strong skill

A leading production consultancy in the UK is seeking a Senior Freelance Producer to evaluate licensing partners in live entertainment.The role involves assessing operational capabilities and ensuring alignment with project goals.Ideal candidates will have over 5 years of experience in live event pr

A global data company is seeking detail-oriented British English speakers for an AI chatbot evaluation project.Participants will engage with AI in voice mode and rate their interactions, focusing on achieving specific conversation goals.This project is remote and allows for flexible hours, but only

A data services company seeks an Urdu language expert to evaluate and enhance AI-generated content.Key responsibilities include ensuring the quality and fluency of responses, crafting natural prompts, and contributing to training AI systems.The role is fully remote and flexible, requiring native or

What if your years of engineering experience could directly influence how the world's most advanced AI systems write and reason about code? We're looking for experienced software engineers to evaluate frontier AI models — hunting down bugs, exposing failure modes, and helping ensure that AI‑gene

A technology company in the United Kingdom is seeking an Analyst to join their team for training AI models.The successful candidate will evaluate chatbot logic and measure progress to enhance model quality.Candidates should possess a strong understanding of mathematics and relevant academic qualific

A leading AI talent platform offers a position as a Bilingual AI Response Evaluator.

A project-based AI opportunity provider in the United Kingdom is seeking mathematicians for flexible, part-time roles focused on designing rigorous mathematics problems and evaluating AI solutions.Candidates should have a degree in Mathematics and 2+ years of relevant experience.Strong written Engli

A cutting-edge AI firm seeks an AI Model Evaluation Specialist to evaluate AI-generated responses for accuracy and usefulness.This remote role involves writing prompts and providing evaluations based on industry standards.Candidates should hold a Master's degree in Health or a relevant field, posses

A leading AI opportunity platform in the UK seeks Computer Science experts for project-based roles focused on testing and improving AI systems.Ideal candidates should possess a degree in Computer Science, strong Python skills, and have at least 2 years of experience in relevant fields.This opportuni

A healthcare advisory firm is looking for a Professional Domain Expert to evaluate AI-generated responses in medical contexts.This part-time position offers hourly compensation ranging from $50 to $75, aimed at candidates with a master's degree in healthcare or medical fields.Responsibilities includ

A technology company in the United Kingdom is seeking an Energy Research Scientist to train AI models by evaluating their outputs and improving their logic.Applicants should have expertise in physics, preferably with a Master's or PhD.This position is remote and offers flexibility in project selecti

An educational technology firm in the United Kingdom seeks a part-time professional to evaluate AI-generated outputs, focusing on K-12 education.Responsibilities include creating scenarios like IEP development and annotating data for instructional effectiveness.Strong experience in K-12 education an

A forward-thinking AI training company in the United Kingdom is seeking a Web Developer/Designer to improve AI understanding of visual and design elements.The role includes critiquing AI-generated designs and helping train models for better usability.Candidates should have a background in UI/UX or g

Bilingual AI Response Evaluator.

A technology company is seeking a Physics Research Scientist to improve AI models by evaluating their performance through complex physics problems.This role requires expert-level knowledge in physics or related fields.You will have the flexibility to choose projects and work on your own schedule as

This job is with Ingeus, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.Please do not contact the recruiter directly.Outreach Case Worker (Justice).Location: Durham, Middlesborough and Darlington and surrounding areas.Rebuilding your l

This job is with Santander UK, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.Please do not contact the recruiter directly.Customer Service Advisor | S1 | Everyday Banking | Multiple Locations.This is more than a strategic shift.It's a

Discovery, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.Please do not contact the recruiter directly.Discovery… the stuff dreams are made of.When we say, “the stuff dreams are made of,” we’re not just referring to the world o

This job is with Santander UK, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.Please do not contact the recruiter directly.Santander Consumer Finance (SCUK) are looking for passionate.This is a hybrid position, where you will be requir

This job is with Capgemini, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.Please do not contact the recruiter directly.About the role you're considering.Are you based in the Bath area? We’re keen to connect with people who enjoy wor

Children's Residential Senior Support Worker.We are the Cambian Group, the largest independent provider of care and education for children and young people.Cambian employees are friendly, supportive and all focused on achieving the best outcomes for everyone involved with our brand.The young people

CAMHS Professionals is recruiting experienced Children's Residential Support Workers to join a bank of professionals supporting children's care homes across Surrey, on behalf of a local authority client.This is a flexible, ad hoc role where we work around your availability.Each week we'll reach out,

We are seeking an innovative Social Worker to join our Intensive Support Team in Medway.This permanent, full-time position offers an annual salary of £42,823.Working within our dedicated and vibrant team, you will be at the forefront of delivering meaningful change and making a real impact in the c

Residential Support Worker (Complex Care / Supported Living).Registered Manager / Team Leader.To provide high-quality, person-centred support to individuals with learning disabilities, complex needs, mental health conditions, and behaviours that challenge.The role focuses on promoting independence,

Are you looking for a flexible work from home opportunity? On Freecash, you are in control of your earnings.We provide a platform where you can choose from a wide range of paid online tasks, including testing mobile games, participating in market research, and completing digital offers.There are no

Senior Support Worker - Homelessness Services Oxford £28,428 per year 37.Permanent Shift Pattern (4-Week Rota) Week 1: Monday - Friday, 8:00am - 4:00pm Week 2: Monday - Friday, 12:00pm - 8:00pm Week 3: Monday - Wednesday 9:00am - 5:00pm | Saturday & Sunday 8:00am - 8:00pm Week 4: Wednesday