Senior Data Scientist LLM

Elsevier • Full-time • Philadelphia, PA, US • 1d ago

Do you have expertise in evaluating and implementing Generative AI models?

Are you passionate about applying data science to advance Healthcare and Education?

About our Team

Elsevier is singularly focused on helping healthcare and health education professionals improve clinical outcomes through evidence-based methods. Our data science team works on designing, building, and maintaining NLP solutions for Generative AI Evaluation of Health and Health Education applications.

About the Role

We are seeking an experienced Senior Data Scientist III to join our Applied AI Evaluation team. You will lead the design, implementation, and maintenance of NLP solutions for Generative AI evaluation, focusing on ClinicalKey AI and Sherpath AI products. This role requires expertise in data science, mentoring capabilities, and the ability to deliver production-ready solutions.

Responsibilities

· Designing and conducting experiments to assess generative AI model performance

· Developing metrics, benchmarks, and evaluation frameworks

· Creating production-ready Python packages for evaluation pipeline components

· Evaluating AI models against healthcare domain standards

· Integrating data science components and conduct quality assessments

· Developing automated evaluation and maintenance tools

· Mentoring junior team members and providing technical leadership

· Collaborating with technology teams for pipeline deployment

· Implement and maintain product performance reporting

· Contributing to new methodologies and governance frameworks

Requirements