Risk Model Validation Associate - GenAI & Machine Learning Job at Santander Holdings USA Inc Careers, New York, NY

aVlFQlFVdytqZ0RDeWR0RDgzSjlXZUFPQ1E9PQ==
  • Santander Holdings USA Inc Careers
  • New York, NY

Job Description

Risk Model Validation Associate - GenAI & Machine Learning

Boston, United States of America

The Associate, Risk Modeling conducts robust validations of a wide variety of risk models against established standards, develops benchmarks, and challenges and replicates models where applicable. Manages models of advanced complexity and leads special projects and/or programs.

  • Reviews and assesses overall model health within a given framework, identifies potential problems and works with stakeholders to resolve.

  • Conducts robust validations of a wide variety of models against established standards, develops benchmarks, challenges, and replicates models where applicable.

  • Assesses model performance and evaluates model assumptions and weaknesses.

  • Collaborates with model owners and develops to understand the business context for models.

  • Ensures adherence to the policies and procedures established by the company.

 

Qualifications: To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

  • Education: Bachelor's Degree or equivalent work experience. Master’s or equivalent degree in Statistics, Mathematics, Engineering, Computer Science, Economics, or related fields is a preferred.

  • Work Experience: 5+ years developing or validating quantitative machine learning (ML) models or Large Language Models (LLMs) frameworks. Experience in the financial services industry, including expertise in risk modeling and regulatory compliance (SR 11-7) is preferred.

  • AI/ML Expertise: Demonstrated experience with Artificial Intelligence and Machine Learning (AI/ML) frameworks such as TensorFlow, PyTorch and Scikit-learn. Hands-on experience with gradient boosting models, NN and other ML algorithms for classification and regression.

  • LLM Knowledge: Experience with LLMs framework including model’s architecture, methodology, implementation, APIs, and evaluation, with working knowledge of prompt-tuning and RAG/fine-tuning LLMs applications. Leaderboards review. Experience with Hugging Face models and datasets, and testing design and execution for GenAI risks such as hallucination, accuracy, toxicity, prompt injection, bias etc.

  • Programming skills: Proficiency in Python and R. Experience in cloud-based solutions (AWS, Azure) is a plus.

  • Excellent organizational skills, strong communication, with the ability to work cross-functionally with model developers, data engineers, technology, and governance teams.

EEO Statement: At Santander, we value and respect differences in our workforce. We actively encourage everyone to apply.

Santander is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, genetics, disability, age, veteran status or any other characteristic protected by law.

This job description does not list all of the job duties of the job. You may be asked by your supervisors or managers to perform other duties. You may be evaluated in part based upon your performance of the tasks listed in this job description. The employer has the right to revise this job description at any time. This job description is not a contract for employment and either you or the employer may terminate at any time for any reason.

Primary Location:  Boston, MA, Boston

Other Locations:  Massachusetts-Boston,Texas-Dallas,New York-New York

Organization:  Santander Holdings USA, Inc.

Salary: $90,000 - $165,000/year

Job Tags

Contract work, Work experience placement,

Similar Jobs

Hair Cuttery

Licensed Salon Manager Job at Hair Cuttery

 ...highest in the industry Exclusive time-management and financial goal-setting strategies to...  ...corrective color, chemical treatments, keratin, hair extensions, and more All hair products...  ...at no cost to you As a Licensed Salon Leader for HC Family of Brands, you will:... 

Nesco Resource

Cherry Picker & Shipping Job at Nesco Resource

Candidate Duties: Shipping, Receiving, Forklift operation, Cherry Picker operation (fear of heights, not a good match), Stand Up Forklift operation, picking, packing, etc as needed. Nesco Resource and affiliates (Lehigh G.I.T Inc, and Callos Resource, LLC) is an equal... 

Midnight Oil

Account Manager Job at Midnight Oil

 ...conveniently combine our Studio and Print Production capabilities all under one roof in our 120,000 square feet facility, with an Amtrak stop and the Burbank Airport directly across the street. However, our secret ingredient is simply our people we have the best,... 

Singh Development Company

Part-Time Personal Caregiver Job at Singh Development Company

 ...years' experience working with senior population. Ability to follow...  ...resident emergency call system in a timely manner. Provide assistance...  ...leadership. We are all a part of a team who are here to...  ...prior work experience in a senior citizen setting. Integrity and... 

Schneider's Computing Ltd

Cell Phone Repair Technician Job at Schneider's Computing Ltd

 ...Job Description Job Description -Fix and repair Samsung, Apple, Google cell phones and tablets including battery replacements, charge ports, LCDs, digi, various components including mico-soldering a MUST -must know how to micro-sold iPad charge ports and laptop charge...