Software Engineer
San Francisco, California, United StatesFull-time$165,200–$223,600Posted Aug 30, 2026
About the role
We're hiring on behalf of a Haystack partner!
The Role
- Develop and maintain high-performance runtime libraries and drivers for machine learning applications and AI accelerators.
- Design, develop, and deploy core components of a machine learning acceleration software stack.
- Optimize AI workloads across custom hardware platforms by providing deep insights into performance bottlenecks.
- Improve the performance of machine learning kernels and frameworks.
- Manage the full development life cycle of runtime software, ensuring scalability, reliability, and usability.
- Collaborate with cross-functional teams to ensure compiler outputs are optimized for custom hardware.
What You'll Need
- 3+ years of professional software development experience.
- 2+ years of experience in designing or architecting new and existing systems, focusing on reliability and scaling.
- Proficiency in at least one programming language.
- Experience with the full software development life cycle, including coding standards, code reviews, source control, build processes, testing, and operations.
- Experience in architecting, building, and operating distributed systems with a focus on high availability and fault tolerance.
- Hands-on experience with cloud services in production environments.
What's On Offer
- Competitive annual salary ($165,200 - $223,600 USD) plus potential for sign-on payments and restricted stock units.
- Comprehensive benefits package including health insurance, 401(k) matching, paid time off, and parental leave.
- Opportunities for mentorship and career growth within a supportive team environment.
- Flexibility in working hours to promote work-life balance.
Apply via Haystack today!
Responsibilities
- Develop and maintain high-performance runtime libraries and drivers for machine learning applications and AI accelerators
- Design, develop, and deploy core components of a machine learning acceleration software stack
- Optimize AI workloads across custom hardware platforms by providing deep insights into performance bottlenecks
- Improve the performance of machine learning kernels and frameworks
- Manage the full development life cycle of runtime software, ensuring scalability, reliability, and usability
- Collaborate with cross-functional teams to ensure compiler outputs are optimized for custom hardware
Qualifications
- 3+ years of professional software development experience
- 2+ years of experience in designing or architecting new and existing systems, focusing on reliability and scaling
- Proficiency in at least one programming language
- Experience with the full software development life cycle, including coding standards, code reviews, source control, build processes, testing, and operations
- Experience in architecting, building, and operating distributed systems with a focus on high availability and fault tolerance
- Hands-on experience with cloud services in production environments
Benefits
- Competitive annual salary plus potential for sign-on payments and restricted stock units
- Comprehensive benefits package including health insurance, 401(k) matching, paid time off, and parental leave
- Opportunities for mentorship and career growth within a supportive team environment
- Flexibility in working hours to promote work-life balance
Skills mentioned
C++System DesignDistributed SystemsPerformance OptimizationSoftware TestingGitCloud ComputingSystems EngineeringConcurrencyMachine Learning
About Haystack
Haystack combines AI & expert vetting to deliver world-class tech candidates who are engaged, aligned, and ready to interview. We're trusted by over 400,000+ tech candidates, working in Software Engineering, Data, Design, DevOps, Cloud, Tech Management, Testing, Product & Delivery, Architecture and more. 100s of employers from startups and scale-ups like Atom Bank, DuckDuckGo and Goodlord to established enterprises like American Express, Dunelm and AWS use Haystack to connect with qualified tech talent that they can't find anywhere else.
Technology51-200 employeesNewcastle upon Tyne, England