Quality rater jobs in New York, New YorkCreate job alerts

Job Title: Surgical Clinical Reviewer Do you have the following skills, experience and drive to succeed in this role Find out below. Location: Cooperman Barnabas Medical Ctr Department Name: Department of Surgery Req #: Status: Salaried Shift: Day Pay Range: $58,000.00 - $78,000.00 per year Pay Transparency: The above reflects the anticipated annual salary range for this position if hired to work in New Jersey. The compensation offered to the candidate selected for the position will depend on several factors, including the candidate's educational background, skills and professional experience. Job Overview: The Surgical Clinical Reviewer s chief responsibility is to collect and submit reliable data to the ACS NSQIP, This is accomplished through high-quality data compilation, documentation and entry into the ACS NSQIP database of all eligible surgeries for the hospital.The SCR works closely with the members of the Department of Surgery to identify opportunities for clinical quality improvement (QI), patient safety (PS) initiatives, and other special projects as may be identified. The SCR will also be responsible for assisting surgical residents in identifying and initializing QI and PS research projects, Qualifications: Required Master's level degree in a health care related field. Ability to complete all training modules and pass the ACS NSQIP certification examination, Preferred: Minimum one year experience in hospital surgery department, surgery clinic, clinical research or medical records, Contact with Others: Administrators, physicians, residents, students, hospital personnel, patients/patient families Computer and Internet experience required — familiarity and comfort with MS Office products is essential for success in this position (Word and Excel- required; PowerPoint and Access preferred). Scheduling requirements: Full time days Fully remote in New Jersey. Essential Functions: Identifies surgical patients for inclusion in the Program through the application of Program inclusion/exclusion criteria and protocols. Collects preoperative, operative, and postoperative data components for the Program through the effective utilization of the hospital medical record systems. Attends weekly Quality Improvement (Morbidity & Mortality, Tumor Board, etc.) conferences to ensure reliable data collection of postoperative occurrences. Demonstrates applicability of the methodology and the reliability of definitions utilized by reviewers within the Program through Inter-Rater Reliability (IRR) testing Identifies streamlining and process improvement opportunities in the data collection process. Demonstrates appropriate utilization of resources necessary to obtain valid, reliable data for entry into the Program Establishes effective working relationships with members of the hospital community, especially staff in the Surgery, Medicine, Nursing, Health Information Management and the Information Systems Departments whose support is necessary for the management and success of the Program. Contacts patients and/or families via telephone and/or written communications postoperatively for the purpose of identifying possible occurrences associated with surgical procedures performed at the hospital. Serves as an educational resource on the ACS NSQIP for internal and external audiences by developing educational material and delivering presentations. Successfully completes the ACS NSQIP SCR Training/Certification Program. Participates in Program teleconferences. Attends ACS NSQIP National Conference. Benefits and Perks: At RWJBarnabas Health, our market-competitive Total Rewards package provides comprehensive benefits and resources to supports our employees’ physical, emotional, social, and financial health. Paid Time Off (PTO) Medical and Prescription Drug Insurance Dental and Vision Insurance Retirement Plans Short & Long Term Disability Life & Accidental Death Insurance Tuition Reimbursement Health Care/Dependent Care Flexible Spending Accounts Wellness Programs Voluntary Benefits (e.g., Pet Insurance) Discounts Through our Partners such as NJ Devils, NJ PAC, Verizon, and more! Choosing RWJBarnabas Health! RWJBarnabas Health is the premier health care destination providing patient-centered, high-quality academic medicine in a compassionate and equitable manner, while delivering a best-in-class work experience to every member of the team. We honor and appreciate the privilege of creating and sustaining healthier communities, one person and one community at a time. As the leading academic health system in New Jersey, we advance innovative strategies in high-quality patient care, education, and research to address both the clinical and social determinants of health. RWJBarnabas Health aims to truly make a unique impact in local communities throughout New Jersey. From vastly improving the health of local residents to creating educational and career opportunities, this combination greatly benefits the state. xtnlbfm We understand the growing and evolving needs of residents in New Jersey—whether that be enhancing the coordination for treating complex health conditions or improving community health through local programs and education. Equal Opportunity Employer

Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Generalist Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities • Review, evaluate, and annotate AI outputs with extreme attention to detail., • Follow complex guidelines precisely and apply them consistently across tasks., • Identify subtle errors, edge cases, and quality issues others might miss., • Provide clear, structured feedback to improve downstream AI training quality., • Maintain high accuracy across repetitive, high-volume workflows. Must-Have • Exceptionally detail-oriented and quality-obsessed mindset., • Prior experience as a CB / reviewer / rater in human data or AI training pipelines., • Proven ability to follow nuanced instructions without deviation., • Strong written communication and reasoning skills., • High reliability, consistency, and comfort with repetitive precision work., • Experience with large-scale AI data annotation or evaluation programs., • Background in QA, operations, trust & safety, or structured review work., • Familiarity with multi-step rubric-based evaluations., • Hourly contractor, • Upload resume, • AI interview based on your resume

Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Generalist Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities • Review, evaluate, and annotate AI outputs with extreme attention to detail., • Follow complex guidelines precisely and apply them consistently across tasks., • Identify subtle errors, edge cases, and quality issues others might miss., • Provide clear, structured feedback to improve downstream AI training quality., • Maintain high accuracy across repetitive, high-volume workflows. Must-Have • Exceptionally detail-oriented and quality-obsessed mindset., • Prior experience as a CB / reviewer / rater in human data or AI training pipelines., • Proven ability to follow nuanced instructions without deviation., • Strong written communication and reasoning skills., • High reliability, consistency, and comfort with repetitive precision work., • Experience with large-scale AI data annotation or evaluation programs., • Background in QA, operations, trust & safety, or structured review work., • Familiarity with multi-step rubric-based evaluations., • Hourly contractor, • Upload resume, • AI interview based on your resume

Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Generalist Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities • Review, evaluate, and annotate AI outputs with extreme attention to detail., • Follow complex guidelines precisely and apply them consistently across tasks., • Identify subtle errors, edge cases, and quality issues others might miss., • Provide clear, structured feedback to improve downstream AI training quality., • Maintain high accuracy across repetitive, high-volume workflows. Must-Have • Exceptionally detail-oriented and quality-obsessed mindset., • Prior experience as a CB / reviewer / rater in human data or AI training pipelines., • Proven ability to follow nuanced instructions without deviation., • Strong written communication and reasoning skills., • High reliability, consistency, and comfort with repetitive precision work., • Experience with large-scale AI data annotation or evaluation programs., • Background in QA, operations, trust & safety, or structured review work., • Familiarity with multi-step rubric-based evaluations., • Hourly contractor, • Upload resume, • AI interview based on your resume

Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Generalist Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities • Review, evaluate, and annotate AI outputs with extreme attention to detail., • Follow complex guidelines precisely and apply them consistently across tasks., • Identify subtle errors, edge cases, and quality issues others might miss., • Provide clear, structured feedback to improve downstream AI training quality., • Maintain high accuracy across repetitive, high-volume workflows. Must-Have • Exceptionally detail-oriented and quality-obsessed mindset., • Prior experience as a CB / reviewer / rater in human data or AI training pipelines., • Proven ability to follow nuanced instructions without deviation., • Strong written communication and reasoning skills., • High reliability, consistency, and comfort with repetitive precision work., • Experience with large-scale AI data annotation or evaluation programs., • Background in QA, operations, trust & safety, or structured review work., • Familiarity with multi-step rubric-based evaluations., • Hourly contractor, • Upload resume, • AI interview based on your resume

Job Description Company Overview: Harris Energy Solutions, LLC (HES) offers nationwide Energy Consulting Services, specializing in a wide range of energy management solutions. Our distinguished team includes skilled Engineers, Certified Energy Managers (CEM), Certified Building Commissioning Professionals (CBCP), and Solar Design Specialists. With extensive experience across various facets of energy management, HES excels in services such as building energy modeling, renewable energy consulting, master planning, energy auditing, and building commissioning. Our commitment to excellence and innovation ensures we deliver tailored, cutting-edge solutions that meet the unique energy needs and goals of our clients across the nation. Position Overview: HES is seeking a detail-oriented Inspector to join our field inspections team supporting a utility program in New York. The Inspector will perform on-site air sealing and attic insulation inspections at multifamily properties, document conditions through photos and video, and produce post-inspection reports. This is a field-based role that benefits from solid attention to detail, good documentation habits, and the ability to manage a regular schedule of inspections across multiple sites. Key Responsibilities: Field Inspections • Conduct on-site air sealing and attic insulation inspections at multifamily properties., • Verify that installed work meets program specifications and applicable standards., • Inspect related building envelope measures as assigned, such as roof and wall insulation, above-deck roof insulation, and window replacement., • Perform interim envelope inspections prior to areas being enclosed; document any areas that have become inaccessible., • Capture date- and time-stamped photographs and video of pre-existing conditions, in-progress work, and completed installations., • Complete pre- and post-inspection reports using approved templates, with accuracy and clarity., • Submit inspection reports in a timely manner, in line with project needs., • Confirm scope of work and required documentation prior to each site visit., • Coordinate site access and scheduling logistics with property contacts and program staff., • Communicate proactively about scheduling, availability, or anything that may affect inspection workflow., • Follow program protocols, inspection checklists, and reporting standards., • Stay current on program guidelines and any updates to inspection requirements., • Conduct inspections in compliance with applicable health and safety standards. Qualifications: All qualifications below are preferred but not required. We are open to candidates from a range of backgrounds and are willing to provide training to the right person. • Some prior experience or interest in building inspections, construction, weatherization, or energy efficiency., • Comfort with basic technology — smartphones, tablets, cameras, and email., • Good written communication and attention to detail., • Ability to travel reliably to job sites within the assigned region. A valid driver's license is helpful but not required if you can consistently reach sites by public transportation, as many of our inspectors do., • Ability to work independently and manage a regular schedule of field visits. Preferred Certifications • BPI Building Analyst, BPI Multifamily Building Analyst, or similar certification., • HERS Rater, RESNET, or comparable credential., • OSHA 10 or OSHA 30 certification., • Prior experience with multifamily building inspections. Education • High school diploma or equivalent required., • Additional coursework, training, or certifications in construction, building science, energy efficiency, or a related field is a plus, but not required., • Relevant hands-on experience may be considered in place of formal education., • We are open to candidates from a variety of backgrounds and provide training for the right individual. Physical Requirements & Working Conditions • Ability to climb ladders and access attics, crawlspaces, rooftops, mechanical rooms, and other confined or elevated spaces., • Ability to lift and carry equipment weighing up to 40 pounds., • Comfort working in varied environmental conditions, including dusty, hot, cold, or noisy spaces., • Ability to stand, kneel, bend, and walk for extended periods throughout the workday. Job Type: Full-time (40 hours per week) Pay: $55,000 per year HES offers a competitive benefits package, paid time off, travel reimbursement for field work, and ongoing professional development and certification support. Benefits: • 401(k) (Traditional and Roth options), • 401(k) Safe Harbor, • Medical Insurance, • Dental Insurance, • Vision Insurance, • HSA option, • Paid Time Off, • Paid Holidays, • Profit Share Plan, • Company Covered Disability Insurance (LTD, STD), • Company Covered Life Insurance EEO Statement: All qualified applicants will receive consideration for employment without regard to age, race, creed, color, national origin, ancestry, marital status, affectional or sexual orientation, gender identity or expression, disability, nationality, or sex.

About Child Mind Institute We're dedicated to transforming the lives of children and families struggling with mental health and learning disorders by giving them the help they need. We've become the leading independent nonprofit in children's mental health by providing gold-standard evidence-based care, delivering educational resources to millions of families each year, training educators in underserved communities, and developing tomorrow's breakthrough treatments. Position Details: As part of the Center for Data Analytics, Innovation, and Rigor team, you will report to Technical Project Manager. You will provide clinical oversight and lead standard-setting for AI evaluation research initiatives in mental health contexts. You will work closely with other project leaders to translate clinical protocols for manualized interventions, documentation, and symptom evaluations into evaluation standards, including the definition of safety thresholds and identification of red-line failure criteria for AI systems. You will manage a small team of clinical experts, coordinating clinical annotation efforts, expert evaluations, and the development of clinically grounded rubrics for assessing both clinician and AI system performance. This role requires deep clinical expertise in mental health, strong leadership skills, and the ability to bridge clinical practice with technical research. This is a full-time, exempt position. A hybrid schedule will be required for employees based in the New York Tri-State area or California Bay Area, with a minimum of four (4) days per week in the office, on a schedule determined by your supervisor. Remote positions will be considered for candidates located outside of these regions . The in-office requirement and schedule are subject to change based on the needs of the program and the organization. Please note: We are not currently able to employ individuals residing in Ohio, North Dakota, Washington, or Wyoming. You Will: • Direct efforts in translation of manualized therapeutic protocols (e.g., BBA, PCIT, CBT) into concrete clinical evaluation criteria that can be operationalized for annotation and assessment of AI systems., • Lead the translation of symptom evaluation frameworks (e.g., semi-structured interviewing, mental status examination) into concrete clinical evaluation criteria that can be operationalized for annotation and assessment of users of AI systems., • Manage clinical staff and coordinate expert annotation workflows across large-scale real and synthetic datasets, including youth engagement where possible and appropriate., • Establish inter-rater reliability protocols and adjudication processes for resolving clinical disagreements in annotation to ensure consistency across diverse clinical evaluators., • Coordinate cross-functional teams including clinicians, scientists, data science professionals, and external collaborators to ensure efficient workflow and communication., • Achieve consensus around rubric definitions, note taking protocols, and overall product vision and priorities across the clinical and leadership teams. You Have: • Master's in Psychology, Counselling, Neuroscience, or equivalent combination of education and experience is required., • 5+ years of experience with manualized therapeutic interventions (e.g., CBT, DBT, behavioral interventions) and diagnostic assessment protocols., • 5+ years of experience in clinical research, quality assurance, or clinical program management., • 3+ years of experience managing clinical staff or supervising clinical trainees., • 3+ years of experience developing or applying clinical protocols, evaluation criteria, or quality standards in research or clinical settings. #LI-hybrid #LI-remote Our Benefits Our great compensation package and benefits include medical insurance, 401(k), paid parental leave, dependent care, flexible work schedules, discounted tickets and entertainment perks programs. For more information about our benefits, please visit our ___. Pay Range The salary range for the position is posted. Factors such as candidate's work experience, education/training, job-related skills, internal peer equity, as well as market and business considerations affect the salary offered within this range. In addition, this salary may be subject to a geographic adjustment (according to a specific city and state and depending on the role), if an authorization is granted to work outside of the location listed in this posting. EEO Disclaimer Child Mind Institute is committed to fostering an inclusive and equitable workplace where all individuals are treated with respect and dignity. We are proud to be an equal opportunity employer and prohibit discrimination and harassment of any kind. We provide equal employment opportunities to all employees and applicants for employment, regardless of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), sexual orientation, gender identity, gender expression, age, national origin, ancestry, citizenship status, marital status, military or veteran status, physical or mental disability, genetic information, medical condition, or any other characteristic protected by applicable federal, state, or local laws. In compliance with California law, we also prohibit discrimination based on reproductive health decision-making, status as a victim of domestic violence, sexual assault, or stalking, or any other category protected by the California Fair Employment and Housing Act (FEHA). In New York, we extend this prohibition to include status as a victim of domestic violence, familial status, or any other characteristic protected by the New York State Human Rights Law (NYSHRL). Child Mind Institute is dedicated to ensuring accessibility and reasonable accommodations for individuals with disabilities or medical conditions. If you require an accommodation to participate in the application process or perform your job, please contact our HR Department at ___ This policy applies to all aspects of employment, including recruitment, hiring, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, benefits, and training.

About Child Mind Institute We're dedicated to transforming the lives of children and families struggling with mental health and learning disorders by giving them the help they need. We've become the leading independent nonprofit in children's mental health by providing gold-standard evidence-based care, delivering educational resources to millions of families each year, training educators in underserved communities, and developing tomorrow's breakthrough treatments. Position Details: As part of the Center for Data Analytics, Innovation, and Rigor team, you will report to Technical Project Manager, you will lead the implementation and validation of evaluation frameworks for assessing both AI systems in clinical and mental health research contexts, and the symptoms of their users. You will own the distillation of clinical definitions into evaluation rubrics, combining applied clinical science with evaluation operations to ensure that rubrics are clinically grounded and operationally scalable. You will work closely with both the clinical and data science teams, ensuring knowledge is effectively operationalized to the satisfaction of both specializations. Supervising a small team of data science and software professionals, you will establish reliability standards, oversee the design of metrics for use in multi-rater evaluation systems, and ensure scientific rigor through quality assurance, versioning, and comprehensive documentation. This is a full-time, exempt position. A hybrid schedule will be required for employees based in the New York Tri-State area or California Bay Area, with a minimum of four (4) days per week in the office, on a schedule determined by your supervisor. Remote positions will be considered for candidates located outside of these regions . The in-office requirement and schedule are subject to change based on the needs of the program and the organization. Please note: We are not currently able to employ individuals residing in Ohio, North Dakota, Washington, or Wyoming. You Will: • Translate clinical symptom evaluations and manualized therapeutic protocols into reliable, consistent, precise, and scorable evaluation criteria., • Design and implement metadata standards and protocols for multi-rater clinical evaluation systems, enabling crowd-sourced ratings from diverse clinical experts., • Set reliability standards and adjudication logic for resolving disagreements among clinical annotators, ensuring consistency across large-scale annotation efforts., • Establish and enforce quality assurance processes, versioning systems, and comprehensive documentation for all evaluation rubrics and measurement frameworks., • Contribute to scientific publications, white papers, and technical documentation of measurement methodologies and validation studies., • Collaborate with clinical leadership to ensure evaluation criteria accurately reflects clinical best practices, safety standards, and clinician feedback., • Supervise and mentor a small team of data analysts and engineers, providing guidance on evaluation methodologies, statistical analysis, and rubric implementation., • Collaborate with other technical project stakeholders, to ensure that technical definitions and requirements of all curated rubrics and resources are being met. You Have: • PhD, PsyD, MD, or equivalent experience in measurement science, psychometrics, biostatistics, clinical psychology, epidemiology, or related field, • 8+ years of applied evaluation experience in clinical research, health outcomes research, or psychometric assessment, • 5+ years of experience with patient evaluation, clinical rating scales, or performance assessment frameworks, • 5+ years of experience in at least one scientific programming language (e.g., Python/R, Matlab) and related toolboxes or frameworks (e.g., Tidyverse, Scipy, Sklearn, Polars, Pytorch) is required. Experience can be concurrent with education., • 5+ years of experience with applied statistics, including reliability analysis, classical test theory, item response theory, or factor analysis., • Demonstrated leadership of multi-rater or benchmark systems. #LI-hybrid #LI-remote Our Benefits Our great compensation package and benefits include medical insurance, 401(k), paid parental leave, dependent care, flexible work schedules, discounted tickets and entertainment perks programs. For more information about our benefits, please visit our ___. Pay Range The salary range for the position is posted. Factors such as candidate's work experience, education/training, job-related skills, internal peer equity, as well as market and business considerations affect the salary offered within this range. In addition, this salary may be subject to a geographic adjustment (according to a specific city and state and depending on the role), if an authorization is granted to work outside of the location listed in this posting. EEO Disclaimer Child Mind Institute is committed to fostering an inclusive and equitable workplace where all individuals are treated with respect and dignity. We are proud to be an equal opportunity employer and prohibit discrimination and harassment of any kind. We provide equal employment opportunities to all employees and applicants for employment, regardless of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), sexual orientation, gender identity, gender expression, age, national origin, ancestry, citizenship status, marital status, military or veteran status, physical or mental disability, genetic information, medical condition, or any other characteristic protected by applicable federal, state, or local laws. In compliance with California law, we also prohibit discrimination based on reproductive health decision-making, status as a victim of domestic violence, sexual assault, or stalking, or any other category protected by the California Fair Employment and Housing Act (FEHA). In New York, we extend this prohibition to include status as a victim of domestic violence, familial status, or any other characteristic protected by the New York State Human Rights Law (NYSHRL). Child Mind Institute is dedicated to ensuring accessibility and reasonable accommodations for individuals with disabilities or medical conditions. If you require an accommodation to participate in the application process or perform your job, please contact our HR Department at ___ This policy applies to all aspects of employment, including recruitment, hiring, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, benefits, and training.

Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Generalist Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities • Review, evaluate, and annotate AI outputs with extreme attention to detail., • Follow complex guidelines precisely and apply them consistently across tasks., • Identify subtle errors, edge cases, and quality issues others might miss., • Provide clear, structured feedback to improve downstream AI training quality., • Maintain high accuracy across repetitive, high-volume workflows. Must-Have • Exceptionally detail-oriented and quality-obsessed mindset., • Prior experience as a CB / reviewer / rater in human data or AI training pipelines., • Proven ability to follow nuanced instructions without deviation., • Strong written communication and reasoning skills., • High reliability, consistency, and comfort with repetitive precision work., • Experience with large-scale AI data annotation or evaluation programs., • Background in QA, operations, trust & safety, or structured review work., • Familiarity with multi-step rubric-based evaluations., • Hourly contractor, • Upload resume, • AI interview based on your resume