Lead Software Engineer - AI

Ladders
RemoteFull-time$129,300–$177,800Posted Aug 31, 2026

About the role

For our client, we are seeking a Lead Software Engineer - AI to join the team of a leader in the Healthcare space.

This role will own the architecture and technical direction for AI-driven software solutions that support healthcare operations and care workflows. You will work closely with product and engineering partners to translate business needs into practical AI features and production-ready systems. The position calls for deep experience building secure, scalable AI/ML capabilities, with particular attention to model performance, reliability, and responsible use of sensitive health data.

Location: Remote - US based candidates only, no visa sponsorship available

Compensation: $129,300 – $177,800 annually

Responsibilities

Design and own the end-to-end architecture of AI systems

Evaluate and guide the fine-tuning of foundation models

Collaborate with product teams to translate care workflows into AI features

Ensure AI systems comply with HIPAA and responsible AI standards

Own technical decisions and collaborate on engineering best practices

Qualifications

B.S. or M.S. in Computer Science, Engineering, or a related field

8+ years of software engineering experience, including 4+ years in production AI/ML systems

Deep experience with large language models and orchestration frameworks such as LangChain and LlamaIndex

Strong proficiency in Python, TypeScript, and modern ML tooling such as Hugging Face and PyTorch

Experience designing and deploying RAG pipelines and vector search systems in production

Knowledge of model fine-tuning approaches and techniques

Understanding of HIPAA requirements and secure handling of protected health information

Benefits

Comprehensive medical, dental, and vision coverage

401(k) retirement savings plan

Paid time off, including personal and company holidays

Paid parental and caregiver leave

Short-term and long-term disability coverage

Life insurance and other wellness benefits

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.

Responsibilities

  • Design and own the end-to-end architecture of AI systems
  • Evaluate and guide the fine-tuning of foundation models
  • Collaborate with product teams to translate care workflows into AI features
  • Ensure AI systems comply with HIPAA and responsible AI standards
  • Own technical decisions and collaborate on engineering best practices

Qualifications

  • B.S. or M.S. in Computer Science, Engineering, or a related field
  • 8+ years of software engineering experience, including 4+ years in production AI/ML systems
  • Deep experience with large language models and orchestration frameworks such as LangChain and LlamaIndex
  • Strong proficiency in Python, TypeScript, and modern ML tooling such as Hugging Face and PyTorch
  • Experience designing and deploying RAG pipelines and vector search systems in production
  • Knowledge of model fine-tuning approaches and techniques
  • Understanding of HIPAA requirements and secure handling of protected health information

Benefits

  • Comprehensive medical, dental, and vision coverage
  • 401(k) retirement savings plan
  • Paid time off, including personal and company holidays
  • Paid parental and caregiver leave
  • Short-term and long-term disability coverage
  • Life insurance and other wellness benefits

Skills mentioned

PythonTypeScriptSystem DesignGenerative AILarge Language ModelsLangChainHugging FacePyTorchRetrieval-Augmented GenerationFine-Tuning

About Ladders

We lead the leaders. Ladder’s community of 10 mm leading professionals come to us to be inspired, grow in their careers, and get ahead in their professional lives. We focus on the $100K+ job market, representing 25% of all jobs and about 50% of income in the US & Canada. We build data-driven tools, marketplaces, news and entertainment products for our growing audience, and the companies, recruiters, and advertisers that want to reach them. We work best with people who enjoy using their talents, commitment and hard work to achieve great successes for millions of real life users through products that impact their careers. We are deeply technology-driven -- about half the company are engineers, technical product people or product designers -- but we never build technology for technology’s sake. We’re always trying to connect our efforts to the good it can do in people’s lives.

Technology51-200 employeesNew York

H-1B sponsorship history

Historical employer filing data was found for Ladders. The employer record includes 8 historical certified applications. This is employer-level history, not a guarantee that this role currently offers sponsorship.