Trabajos scientist en Springfield, IllinoisCrear alertas

Job Description: AI Task Evaluation & Statistical Analysis Specialist ## Role Overview We're seeking a data-driven analyst to conduct comprehensive failure analysis on AI agent performance across finance-sector tasks. You'll identify patterns, root causes, and systemic issues in our evaluation framework by analyzing task performance across multiple dimensions (task types, file types, criteria, etc.). ## Key Responsibilities - Statistical Failure Analysis: Identify patterns in AI agent failures across task components (prompts, rubrics, templates, file types, tags) - Root Cause Analysis: Determine whether failures stem from task design, rubric clarity, file complexity, or agent limitations - Dimension Analysis: Analyze performance variations across finance sub-domains, file types, and task categories - Reporting & Visualization: Create dashboards and reports highlighting failure clusters, edge cases, and improvement opportunities - Quality Framework: Recommend improvements to task design, rubric structure, and evaluation criteria based on statistical findings - Stakeholder Communication: Present insights to data labeling experts and technical teams ## Required Qualifications - Statistical Expertise: Strong foundation in statistical analysis, hypothesis testing, and pattern recognition - Programming: Proficiency in Python (pandas, scipy, matplotlib/seaborn) or R for data analysis - Data Analysis: Experience with exploratory data analysis and creating actionable insights from complex datasets - AI/ML Familiarity: Understanding of LLM evaluation methods and quality metrics - Tools: Comfortable working with Excel, data visualization tools (Tableau/Looker), and SQL ## Preferred Qualifications - Experience with AI/ML model evaluation or quality assurance - Background in finance or willingness to learn finance domain concepts - Experience with multi-dimensional failure analysis - Familiarity with benchmark datasets and evaluation frameworks - 2-4 years of relevant experience

As a Senior Principal Applied Scientist on OCI’s AI Innovation team, you’ll shaping Oracle’s next generation AI infrastructure.

As an Applied Scientist sitting within our Data Science organization, you will be responsible for building cutting edge models to navigate critical tradeoffs to drive business value.

As a Senior Applied Scientist of the OCI Generative AI Science team, you will work with experienced scientists and engineers to research, develop, and improve speech and conversational AI models. At Oracle Cloud Infrastructure (OCI), we are building the future of the cloud for enterprises, leveragin

Details for the position are as follows:.Location: Lake County, IL 60064 - 100% onsite - open to candidates who are willing to relocate at their own expense.The Biologics CMC Developability (BCD) group sits at the interface of discovery and development.The core role of BCD is to deliver meaningful a

As our Principal Applied Scientist, you will play a key role in shaping the future of AI at Oracle, with an emphasis on Large Language Models (LLMs) and Generative AI. Lead and mentor both junior and senior applied scientists. Demonstrated experience leading and mentoring early-career scientists.

Specifically, we’re looking for a Senior Data Scientist to join our Retail Trading Team.

Oracle Health Data Intelligence (HDI) is leading the charge in transforming healthcare with innovative data and AI solutions.We’re seeking a highly skilled individual contributor to join our team in the USA.This role focuses on leveraging advanced machine learning techniques, including generative

Research Scientist Responsibilities:.

As an Applied Scientist on the Generative AI Service team, you will spearhead the development of scalable, high-performance AI model training and serving systems in collaboration with fellow applied scientists and software engineers.

For results-driven and caring individuals who want to make a meaningful difference in the world, Parexel is trusted by life sciences companies to meet their long-term staffing needs for scientists and engineers and related professionals in discovery and development of novel therapies, keeping patien

We are seeking an exceptional applied scientist to work on innovative Generative AI & Analytics modeling research and development efforts. As a Senior Principal Applied Scientist in Generative AI Science team, you will be architecting, building and deploying cutting-edge, high-quality AI models and

Preferred qualifications for this position include Professional Wetland Scientist (PWS) certification, or a state-specific certification or licensure related to wetland science.

As the Code Assist generation model scientist lead, you will be responsible for driving the development and implementation of cutting-edge code generation and manipulation technologies. You will lead a team of world-class scientists in exploring new frontiers of code generation for the most popular

Invent, implement and deploy state-of-the-art machine learning and/or specific domain industry algorithms and systems.Build AI Agents on top of the latest reasoning LLMs (both frontier and open source) and analyze agent trajectories.Build prototypes and explore conceptually new solutions.Work collab

You will lead a team of world-class scientists in exploring new frontiers of code generation for the most popular languages simplifying documentation, unit testing, optimizing existing code, explaining code and simplifying way users interact with the database systems enabling natural language interf

Invent, implement and deploy state-of-the-art machine learning and/or specific domain industry algorithms and systems.Build prototypes and explore conceptually new solutions.Work collaboratively with science, engineering, and product teams to identify customer needs in order to create and implement

This role will be working in the Redwood City, CA office.The Oracle Applied AI team is at the forefront of developing cutting-edge AI solutions that push the boundaries of machine learning, LLM applications and AI agents.We work on real-world AI applications, deploying scalable and production-ready

Invent, implement and deploy state-of-the-art machine learning and/or specific domain industry algorithms and systems.Build prototypes and explore conceptually new solutions.Work collaboratively with science, engineering, and product teams to identify customer needs in order to create and implement

We are seeking a Senior Principal Applied Scientist to spearhead Generative AI and Agent use cases that support GBU business applications as well as GBU consulting. As an applied scientist, you will be responsible for driving the development and implementation of cutting-edge technologies. You will

We're seeking a Senior Manager of Engineering & Applied Scientists -a hands-on technology leader who thrives on solving complex challenges in distributed systems, cloud infrastructure, and highly available services.