Senior Software Engineer

Haystack
San Francisco, California, United StatesFull-time$212,700–$287,700Posted Aug 30, 2026

About the role

We're hiring on behalf of a Haystack partner!

The Role

  • Lead a team of engineers focused on enabling new machine learning customers on a specialized SDK and platform.
  • Own the customer onboarding journey from model evaluation through production training at scale.
  • Drive engineering initiatives to maximize Model FLOPS Utilization (MFU) for customer workloads through performance analysis, profiling, and tuning tools.
  • Build and maintain tooling, automation, and documentation that accelerates time-to-first-training for new customer models.
  • Partner with compiler, runtime, and framework teams to identify and resolve blockers in customer workloads.
  • Develop scalable processes for distributed training enablement.

What You'll Need

  • Experience working with PyTorch or JAX software.
  • 3+ years of engineering team management experience.
  • 7+ years of experience working directly within engineering teams.
  • 3+ years of designing or architecting new and existing systems.
  • Experience partnering with product or program management teams.
  • 3+ years of experience in deep learning/machine learning, including model training workflows.
  • Experience with distributed training at scale.

What's On Offer

  • Competitive annual salary ($212,700 - $287,700) plus potential for sign-on payments and restricted stock units.
  • Comprehensive benefits package including health insurance, 401(k) matching, paid time off, and parental leave.
  • Opportunities for mentorship and career growth within a dedicated team.
  • A culture that values work-life balance and inclusive team dynamics.

Apply via Haystack today!

Responsibilities

  • Lead a team of engineers focused on enabling new machine learning customers on a specialized SDK and platform
  • Own the customer onboarding journey from model evaluation through production training at scale
  • Drive engineering initiatives to maximize Model FLOPS Utilization (MFU) for customer workloads through performance analysis, profiling, and tuning tools
  • Build and maintain tooling, automation, and documentation that accelerates time-to-first-training for new customer models
  • Partner with compiler, runtime, and framework teams to identify and resolve blockers in customer workloads
  • Develop scalable processes for distributed training enablement

Qualifications

  • Experience working with PyTorch or JAX software
  • 3+ years of engineering team management experience
  • 7+ years of experience working directly within engineering teams
  • 3+ years of designing or architecting new and existing systems
  • Experience partnering with product or program management teams
  • 3+ years of experience in deep learning/machine learning, including model training workflows
  • Experience with distributed training at scale

Benefits

  • Competitive annual salary plus potential for sign-on payments and restricted stock units
  • Comprehensive benefits package including health insurance, 401(k) matching, paid time off, and parental leave
  • Opportunities for mentorship and career growth within a dedicated team
  • A culture that values work-life balance and inclusive team dynamics

Skills mentioned

Deep LearningPyTorchJAXMachine LearningDistributed SystemsSystem DesignPerformance OptimizationAutomationMLOpsModel Deployment

About Haystack

Haystack combines AI & expert vetting to deliver world-class tech candidates who are engaged, aligned, and ready to interview. We're trusted by over 400,000+ tech candidates, working in Software Engineering, Data, Design, DevOps, Cloud, Tech Management, Testing, Product & Delivery, Architecture and more. 100s of employers from startups and scale-ups like Atom Bank, DuckDuckGo and Goodlord to established enterprises like American Express, Dunelm and AWS use Haystack to connect with qualified tech talent that they can't find anywhere else.

Technology51-200 employeesNewcastle upon Tyne, England