Senior Data Scientist LLM

Do you have expertise in evaluating and implementing Generative AI models?

Are you passionate about applying data science to advance Healthcare and Education?

About our Team

Elsevier is singularly focused on helping healthcare and health education professionals improve clinical outcomes through evidence-based methods. Our data science team works on designing, building, and maintaining NLP solutions for Generative AI Evaluation of Health and Health Education applications.

About the Role

We are seeking an experienced Senior Data Scientist III to join our Applied AI Evaluation team. You will lead the design, implementation, and maintenance of NLP solutions for Generative AI evaluation, focusing on ClinicalKey AI and Sherpath AI products. This role requires expertise in data science, mentoring capabilities, and the ability to deliver production-ready solutions.

Responsibilities

· Designing and conducting experiments to assess generative AI model performance

· Developing metrics, benchmarks, and evaluation frameworks

· Creating production-ready Python packages for evaluation pipeline components

· Evaluating AI models against healthcare domain standards

· Integrating data science components and conduct quality assessments

· Developing automated evaluation and maintenance tools

· Mentoring junior team members and providing technical leadership

· Collaborating with technology teams for pipeline deployment

· Implement and maintain product performance reporting

· Contributing to new methodologies and governance frameworks

Requirements

· Advanced degree in computer science, data science, AI, mathematics, or statistics

· 2+ years post-PhD or 5+ years post-Master's or 10+ years post-Bachelor's relevant experience

· Expertise in Generative AI model evaluation and metric development

· Proficiency in Python, SQL, R, and Java

· Experience with ML algorithms, deep learning, and neural networks

· Strong background in GitLab/GitHub and cloud computing

· Proven experience with *nix systems and Jupyter notebook hubs

· Ability to build and test new processes while mentoring others

· Healthcare domain knowledge highly desirable

· Track record of developing novel code solutions and best practices