Sr. Software Engineer - AI/ML

Supermicro
San Jose, California, United StatesFull-time$160,000–$200,000Posted Sep 15, 2026

About the role

Job Req ID: 30246

About Supermicro

Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented global expansion has provided us with the opportunity to offer a large number of new positions to the technology community. We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.

Job Summary

Supermicro is seeking a top-notch hands-on Sr. Software Engineer to work on PCIe, SAS/SATA, USB and other HW related areas of storage and server products. As part of our small but important software engineering team, you will be responsible for leading the projects and provide technical expertise and recommendations to support and enhance our development projects.

Essential Duties And Responsibilities

Create and maintain several end-to-end AI agent pipelines that handle high-volume customer support and technical tickets-

Connect and process data from various internal and external data sources

Present demonstrations and updates to internal stakeholders

Define success metrics and iterate deployed services based on production feedback

Qualifications

Bachelor’s degree in Computer Science, Mathematics, IT, or other related field (or equivalent practical experience)

Software engineering background with experience shipping production services

Strong proficiency in Python and ML/LLM frameworks

Proficiency with Linux, Git, and Docker- Experience with SQL, NoSQL, and vector databases

Experience building and deploying production-ready systems that use large language models.

Strong problem-solving and communication skills.

Experience handling confidential or sensitive customer dataPreferred

Hands-on experience with LLM tooling and agent frameworks (LangChain or similar)

Familiarity with MLOps practices and/or model evaluation frameworks

Experience integrating models via APIs and serving them at scale

Salary Range

$160,000 - $ 200,000

The salary offered will depend on several factors, including your location, level, education, training, specific skills, years of experience, and comparison to other employees already in this role. In addition to a comprehensive benefits package, candidates may be eligible for other forms of compensation, such as participation in bonus and equity award programs.

EEO Statement

Supermicro is an Equal Opportunity Employer and embraces diversity in our employee population. It is the policy of Supermicro to provide equal opportunity to all qualified applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status or special disabled veteran, marital status, pregnancy, genetic information, or any other legally protected status.

Responsibilities

  • Create and maintain several end-to-end AI agent pipelines that handle high-volume customer support and technical tickets
  • Connect and process data from various internal and external data sources
  • Present demonstrations and updates to internal stakeholders
  • Define success metrics and iterate deployed services based on production feedback

Qualifications

  • Bachelor’s degree in Computer Science, Mathematics, IT, or other related field (or equivalent practical experience)
  • Software engineering background with experience shipping production services
  • Strong proficiency in Python and ML/LLM frameworks
  • Proficiency with Linux, Git, and Docker
  • Experience with SQL, NoSQL, and vector databases
  • Experience building and deploying production-ready systems that use large language models
  • Strong problem-solving and communication skills
  • Experience handling confidential or sensitive customer data

Benefits

  • Comprehensive Benefits Package
  • Bonus
  • Equity Award Programs

Skills mentioned

PythonLinuxGitDockerSQLNoSQLGenerative AILarge Language ModelsAI AgentsLangChain

About Supermicro

Supermicro® (NASDAQ:SMCI), with 30+ years of leadership in Enterprise, cloud, AI, and 5G Telco/Edge Infrastructure solutions, pioneers the industry with Building Block Solutions® and Green Computing servers. Its customizable, efficient, and sustainable IT offerings such as liquid-cooling technology redefine performance standards and environmental responsibility.

Computer Hardware Manufacturing5,001-10,000 employeesSan Jose, CA