MLOps Engineer
Qualis1 Inc.About the role
Role : MLOps Engineer
Location : Sunnyvale, CA 94085 OR Austin, TX)
Must Have Skills
Experience in ML engineering, MLOps, platform engineering, or SRE, including 2+ years working handson with LLMs or LLMpowered applications in production.
Demonstrated experience building evaluation systems for ML or LLM applications test harnesses, benchmark datasets, automated scoring (including LLMasjudge approaches), and regression detection.
Experience with observability and monitoring stacks (e.g., OpenTelemetry, Datadog, GrafanaPrometheus) and, ideally, LLMspecific observability tools (e.g
Detailed Job Description
5 years of experience in ML engineering, MLOps, platform engineering, or SRE, including 2 years working handson with LLMs or LLMpowered applications in production.Demonstrated experience building evaluation systems for ML or LLM applications test harnesses, benchmark datasets, automated scoring including LLMasjudge approaches, and regression detection.Strong software engineering skills in Python and ideally TypeScript, with a track record of building reliable, welltested internal platforms and t
#MLOpsEngineer #MLOps #MachineLearning #MLEngineering #LLM #LLMOps #AIEngineering #AIJobs #SunnyvaleCA #AustinTX #CaliforniaJobs #TexasJobs #HybridJobs #TechJobs #ITJobs
Responsibilities
- Build evaluation systems for ML or LLM applications
- Develop test harnesses and benchmark datasets
- Implement automated scoring and regression detection
Qualifications
- Experience in ML engineering, MLOps, platform engineering, or SRE
- Strong software engineering skills in Python and ideally TypeScript
- Experience with observability and monitoring stacks
Skills mentioned
About Qualis1 Inc.
At Qualis1 Inc., our robust business model is strategically built upon serving diverse industry sectors, including Finance, Health Care, Education, State Government, and Manufacturing. This structured approach not only ensures our financial stability but also empowers us to consistently support our valued employees and exceed our clients’ expectations. Our commitment to excellence drives every aspect of our operations, enabling us to deliver tailored solutions and unparalleled service across various industries.