Staff Software Engineer, AI

Empathy Talent
San Francisco, California, United StatesFull-time$310,000–$310,000Posted Aug 27, 2026

About the role

As a Staff Software Engineer, AI, you’ll help define the technical direction of the AI-powered product and platform—designing and building the software systems that enable highly reliable, production-grade AI agents in complex enterprise environments.

This is a hands-on Staff-level engineering role for someone who combines exceptional software engineering fundamentals, deep AI expertise, strong product instincts, and technical leadership. You’ll work across the stack—from distributed backend systems and AI infrastructure to agent orchestration and customer-facing product experiences—while influencing architecture and engineering standards across the organization.

Location: San Francisco, CA — Hybrid

Compensation: Up to $310,000 base + equity

What You’ll Own

Architect & Build AI-Native Software Systems

Design and build scalable software architecture supporting AI-powered products and agentic workflows

Set technical direction for critical components across the AI application and platform stack

Build reliable distributed systems capable of supporting complex, enterprise-grade AI workloads

Identify architectural and engineering bottlenecks impacting reliability, scalability, and development velocity

Make high-leverage technical decisions and remain hands-on through implementation and production

Build & Ship AI Products

Own complex product areas end-to-end—from architecture and implementation through deployment and iteration

Build agent orchestration, retrieval, workflow, and reasoning systems capable of handling real-world enterprise complexity

Develop the infrastructure surrounding LLMs, including model integrations, prompts, tools, guardrails, evaluations, observability, and feedback loops

Build APIs, backend services, data pipelines, and platform capabilities that power AI-native product experiences

Rapidly prototype new approaches, validate them with real users, and harden successful solutions for production

Debug difficult issues spanning application code, AI behavior, infrastructure, and distributed systems

Drive Engineering Standards & Technical Direction

Partner with Engineering, Product, and Design leadership to translate product strategy into scalable technical architecture

Establish engineering patterns and standards for building reliable AI-powered software

Create reusable platforms, abstractions, APIs, and tooling that increase engineering velocity across the organization

Influence technical decisions across multiple teams and product areas

Mentor senior engineers and raise the technical bar through architecture reviews, code reviews, and hands-on collaboration

Balance long-term architectural quality with the speed required to ship and learn

Advance the AI Platform

Stay at the frontier of LLMs, agents, applied AI, and AI-native software development

Rapidly evaluate new models, frameworks, infrastructure, and techniques for practical production use

Improve how AI systems are evaluated, monitored, debugged, and operated in production

Develop internal knowledge and best practices around building reliable AI applications

Help establish the organization as a technical leader in enterprise and vertical AI

Who You Are

You’re a Staff-level software engineer who happens to be deeply experienced in AI—not an AI researcher who occasionally writes production code.

These principles resonate with you:

Software engineer first: You have exceptional engineering fundamentals and know how to build maintainable, scalable production systems

Deep AI fluency: You understand how modern LLM and agent systems work and can translate rapidly evolving AI capabilities into reliable products

Technical leadership: You influence architecture and engineering direction through expertise and credibility rather than authority

Systems thinker: You understand second-order effects and design beyond the immediate feature

Product-minded: You care about whether customers actually receive value, not simply whether the technology works

Multiplier: Your architecture, tooling, mentorship, and technical decisions make other engineers more effective

Principled pragmatism: You know when sophisticated engineering is warranted and when the right answer is simply to ship

End-to-end ownership: You take responsibility for outcomes—from initial architecture through production reliability

Experience

We care more about capability and trajectory than checking every box, but strong candidates will typically bring:

8+ years of production software engineering experience, with significant experience building AI/ML-powered products or platforms

Staff-level experience owning architecture and complex technical systems across multiple teams or product areas

Deep expertise in TypeScript, Python, backend engineering, APIs, and distributed systems

Proven experience designing and shipping LLM-powered applications into production

Experience building agentic systems, orchestration layers, tool-calling workflows, and multi-step AI applications

Strong knowledge of RAG, retrieval architectures, vector databases, embeddings, and data pipelines

Hands-on experience with modern LLM APIs and ecosystems such as OpenAI, Anthropic, Gemini, LangGraph, or similar technologies

Experience designing evaluation frameworks, observability systems, guardrails, and reliability infrastructure for AI applications

Strong understanding of traditional software reliability alongside the unique failure modes introduced by probabilistic AI systems

Experience designing scalable services and systems for enterprise customers

Track record of influencing technical direction and mentoring experienced engineers

What Should Excite You

AI-native product engineering: Building products where AI is fundamental to the architecture rather than an added feature

Enterprise-grade reliability: Turning probabilistic AI capabilities into software professionals can depend on

Agentic systems: Building agents capable of reasoning, retrieving information, using tools, and completing complex workflows

Human-in-the-loop systems: Determining where automation creates leverage and where expert judgment should remain involved

Nuanced evaluation: Measuring quality when there isn’t always a single objectively correct answer

Explainability: Making AI behavior transparent, debuggable, and trustworthy

Complex domains: Building elegant software for environments involving compliance, security, and enterprise rigor

Shipping real value: Moving quickly from prototype to production and building AI experiences customers actively rely on

Benefits

Comprehensive health and wellness benefits

Flexible time off and work schedules

Technology reimbursements

401(k) plan

Twice-yearly in-person offsites across the U.S.

Wellness benefits starting on your first day

Responsibilities

  • Architect & Build AI-Native Software Systems
  • Design and build scalable software architecture supporting AI-powered products
  • Set technical direction for critical components across the AI application and platform stack
  • Build reliable distributed systems capable of supporting complex AI workloads
  • Make high-leverage technical decisions and remain hands-on through implementation
  • Own complex product areas end-to-end from architecture to deployment
  • Develop infrastructure surrounding LLMs, including model integrations and evaluations
  • Build APIs, backend services, data pipelines, and platform capabilities

Qualifications

  • 8+ years of production software engineering experience
  • Deep expertise in TypeScript, Python, backend engineering, APIs, and distributed systems
  • Proven experience designing and shipping LLM-powered applications
  • Experience building agentic systems and orchestration layers
  • Strong knowledge of retrieval architectures and data pipelines
  • Hands-on experience with modern LLM APIs and ecosystems
  • Experience designing evaluation frameworks and reliability infrastructure

Benefits

  • Comprehensive health and wellness benefits
  • Flexible time off and work schedules
  • Technology reimbursements
  • 401(k) plan
  • Twice-yearly in-person offsites across the U.S.
  • Wellness benefits starting on your first day

Skills mentioned

TypeScriptPythonDistributed SystemsBackend DevelopmentREST APIsGenerative AILarge Language ModelsAI AgentsRetrieval-Augmented GenerationData Pipelines

About Empathy Talent

We start with Empathy, understanding, and a realization that it is not simply “keyword” skills or necessarily even experience that make someone good at a job. We believe that having understanding and gratitude puts us miles above the rest. For both our candidates and clients: our differentiating factor is that we actually understand you. That is why we do what we do - Starting with empathy is our baseline. Candidates: we know our clients and our goal is to find you a place you will fit in, love to work at, and succeed that actually aligns with who you are. Clients: yes, we have better quality, increase speed, and save money. But in reality it’s the fit that matters and we excel at it.

IT Services and IT Consulting11-50 employeesTallinn