Life Sciences (Experimental Biology) - AI Trainer
hace 2 días
Nutley
About the role \n DataAnnotation is looking for experienced bench scientists to evaluate how frontier AI models handle real laboratory work: experimental design, assay QC, troubleshooting a failed run, reading raw instrument output, deciding whether data are usable. You bring the judgment you have built at the bench. We bring the model outputs that judgment is needed to grade. \n In this role, you will design challenging, realistic tasks drawn from your own practice, such as a plate QC and go or no go call on a cell based assay, a flow panel gating review, a cloning strategy check, or a Western blot interpretation with the raw images, run them through frontier AI agents, and evaluate what comes back against a professional standard. \n You will work with realistic professional files, the kind a scientist in your field actually handles: experimental data, protocols, records, reports and correspondence. Some you will assemble yourself; others will be provided. In every case the goal is the same: a task a competent scientist in your field would complete correctly and a frontier model currently gets wrong. \n This is not a traditional lab or analysis role. You will be helping build better AI by putting your knowledge to work in a structured, flexible, fully remote environment. The work is long form and self directed, and clear written reasoning matters as much as technical depth. \n Responsibilities \n\n • Design challenging, realistic experimental biology tasks drawn from your own day to day workflows: the scenario, a prompt phrased the way you would brief a trusted colleague, and the supporting files an agent would need (plate maps and reader output, instrument exports, gel and blot images, flow summaries, protocols and SOPs, notebook entries, QC records, correspondence), using files you author yourself or files that are provided to you.\n, • Run those tasks through frontier AI agents and evaluate the deliverable they produce (the QC summary, experimental plan, troubleshooting memo, or results workbook) against the standard you would hold a colleague to.\n, • Compare two model outputs on identical prompts and files, decide which performed better, and document where each fell short.\n, • Write detailed grading rubrics that specify what a correct deliverable must contain, such as the right controls checked, the right wells excluded and the right diagnosis of a failed run, and explain in writing why a response passes or fails each one.\n, • Flag concrete failures with evidence: controls ignored or misread, edge effects and outliers missed, wrong normalization to a reference, a plausible sounding troubleshooting story the raw data contradict, fabricated values, ignored files, and off brief interpretation of the ask.\n, • Contribute across molecular and cell biology, protein biochemistry, immunology and flow cytometry, imaging and histology, microbiology and virology, in vivo and preclinical work, and laboratory operations and analytical sciences, and review and refine tasks built by other experts.\n\n Domain qualifications \n\n • 3+ years designing and running experiments at a pharma or biotech lab or an academic research lab (counted after undergraduate education).\n, • Depth of experience in at least one of: molecular biology and cloning; cell culture and cell based assays; protein biochemistry; immunology and flow cytometry; imaging and histology; microbiology or virology; in vivo and preclinical work.\n, • Working understanding of several of the other areas above, enough to know what those workflows involve and how they are run (for example, a protein biochemist who also understands how a cell based assay is set up and controlled, and how a flow panel is designed and gated), so you can assess work in adjacent areas and point out what was done correctly or incorrectly.\n, • You have designed and troubleshot experiments, not only executed established SOPs. You can explain what each control is for and diagnose why a run failed.\n, • You generate and QC primary data. You can look at raw instrument output and judge whether a run is usable before anyone makes a figure from it.\n\n General requirements \n\n • Master's or PhD, or a current PhD candidate, in Biology or a directly related field (molecular or cell biology, genetics, immunology, neuroscience, biochemistry, bioinformatics, or computational biology), completed in the U.S., Canada, Europe, or the UK.\n, • 3+ years of hands on experience in your subfield (see Domain qualifications above). Time in an academic lab or research institute counts after undergraduate education.\n, • Able to draw on your own real world experience and day to day workflows to craft scenarios that test whether an AI system can actually do the work.\n, • Hands on practitioner: you currently do (or recently did) the bench or analysis work yourself at an individual contributor level, not solely in a managerial capacity.\n, • Full professional or native level written and spoken English, with strong written communication. You can explain complex scientific reasoning clearly and concisely, and articulate why a result is wrong, not only that it is.\n, • Comfort with ambiguity and attention to detail. You can orient in a new set of files and build an accurate, deep working picture of it quickly, especially when the science sits partly or wholly outside your own specialization. You verify what a document claims against the underlying data.\n, • Capable of interpreting feedback, judging which parts of it are actually correct, and applying it without hand holding. When stuck, you look for the answer rather than waiting for one.\n, • Ability to ramp quickly on unfamiliar work from written material and instructions alone, including where that material is incomplete (for example, writing grading rubrics for the first time).\n, • General familiarity with AI and LLM tools. You have used models like Claude or ChatGPT in life sciences professional work and have the judgment to tell a well reasoned answer from a plausible sounding but incorrect one.\n, • Baseline tech literacy: comfortable with cloud file tools (e.g., Google Workspace), managing browser profiles, downloading and installing desktop apps (e.g., Claude), and everyday file handling (e.g., converting between Excel and Google Sheets, zipping files for sharing).\n, • Available at least 10 hours per week, with no weekly maximum. Consistent availability is valued and more hours are welcome.\n, • Based in the United States, Canada, or the UK (Ireland and Australia may also be accepted).\n\n Compensation and terms \n\n • Pay: $40 - $125/hr USD. Paid via PayPal on a regular cadence.\n, • Contract position. Fully remote. Minimum 10 hours per week with no weekly maximum.\n, • Flexible scheduling. Multi day task timers let you spread work across days.\n, • Access to Claude and ChatGPT is provided through the project; no personal subscription is required.\n\n What to expect \n\n • Apply through the posting link and create your account.\n, • Complete the paid skills assessment (about 4 hours). It tests domain fit, careful reading, task design, rubric judgment and your response to feedback on a prompt. All work must be your own; submissions produced with AI tools are rejected, and this is the single most common reason candidates do not pass.\n, • Our team reviews your assessment. If you pass, you complete onboarding and a short training project that walks through how tasks, files, and rubrics are built.\n, • Propose a task from your professional experience: the scenario, the prompt, the files you will build or choose to use, and where you expect the model to fail. An expert reviewer reads it and sends written feedback either way.\n, • Once your proposal is accepted, build the task in full and run it against frontier models. Every completed task goes through expert review, and experienced contributors are invited to review and refine other experts' tasks.\n, • Each stage is a gate: work must be accepted before you move on. You are compensated for every step you complete, but not every submission is accepted. Feedback and revision are a normal part of the process. Support is available through platform instructions, onboarding materials, a dedicated Slack channel, and office hours.\n\n About DataAnnotation \n DataAnnotation works with frontier AI labs building the world's most advanced models, with the goal of enabling human aligned AI. Our expert programs bring together practicing professionals to evaluate and improve what these models can do in their fields. DataAnnotation believes that human expertise is essential to building trustworthy AI. We don't want AI training AI. We want real scientists in the room. If you have a strong life sciences background and want to put it to work in a new way, we'd love to hear from you. \n #lifescience
