Staff Machine Learning Engineer

Mural Group

Remote (US)unknown$230,000–$300,000Posted Oct 28, 2026

About the role

Location: Remote (US)

Pay: $230,000–$300,000 + bonus + equity

A late-stage, venture-backed enterprise AI company is hiring a Staff ML Engineer to set the technical direction for its agent systems. This is model and systems work that ships to large enterprise customers, not a thin layer over someone else's API.

What you'll do

Design multi-step LLM systems: reasoning, retrieval, planning and tool use

Own evaluation, from offline benchmarks to online experiments and model-graded review

Find and fix failure modes such as hallucination and tool misuse

Set the quality, latency and cost targets the team builds against

Mentor senior engineers and shape how the group works

What you bring

7+ years shipping ML in production, including LLMs at scale

Led the design of complex, multi-step LLM systems

Depth in transformers, embeddings and retrieval

Evaluation experience beyond single prompts

PyTorch or similar, on distributed cloud infrastructure

BS in CS or a related field; MS or PhD a plus

Nice to have: ML shipped before LLMs, then moved into generative AI; detailed retrieval work (chunking, reranking, evals)

Mural Group is recruiting for this role on behalf of a client. Apply here and a Mural recruiter will be in touch.

Responsibilities

  • Design multi-step LLM systems for reasoning, retrieval, planning, and tool use
  • Own evaluation across offline benchmarks, online experiments, and model-graded review
  • Identify and fix failure modes such as hallucination and tool misuse
  • Set quality, latency, and cost targets
  • Mentor senior engineers and shape team practices

Qualifications

  • 7+ years shipping machine learning systems in production, including LLMs at scale
  • Experience leading the design of complex, multi-step LLM systems
  • Deep knowledge of transformers, embeddings, and retrieval
  • Evaluation experience beyond single prompts
  • Experience with PyTorch or similar frameworks and distributed cloud infrastructure
  • BS in computer science or a related field; MS or PhD is a plus
  • Experience shipping machine learning systems before LLMs and moving into generative AI is a plus
  • Detailed retrieval experience, including chunking, reranking, and evaluations, is a plus

Benefits

  • Bonus
  • Equity

Skills mentioned

Machine LearningLarge Language ModelsAI AgentsRetrieval-Augmented GenerationTransformersEmbeddingsPyTorchModel EvaluationDistributed SystemsCloud Computing

About Mural Group

Mural Group is a multi-stage recruiting firm built by industry leading recruiting and staffing experts. We specialize in two distinct verticals--venture backed tech and industrial trades. Mural doesn’t operate like most recruiting firms. We operate like in-house recruiting partners–focused on building and executing a hiring strategy that aligns with your business objectives.

Staffing and Recruiting11-50 employeesNashville, TN