Senior AI Engineer
About the role
Role: Senior AI Engineer — Agentic Systems
Location: Plano, TX, New York/New Jersey, Columbus, OH (5 days onsite)
Role: Customer-Facing AI Agents
The Opportunity
We are a technology organization operating at the scale of a major financial enterprise — and we are building AI agents that serve millions of customers directly. This is not a chatbot bolt-on or an innovation-lab experiment: our agentic platform sits in the production path of real customer conversations, with the reliability, latency, and safety bar that implies.
We're engaging senior engineers who have actually shipped agentic systems — people who have felt the difference between a demo that works and an agent that survives contact with real users. You'll join a small, senior team moving at startup pace with enterprise-scale distribution.
What You'll Do
- Design and build production agentic workflows for customer-facing use cases — multi-turn conversation, tool calling, retrieval, escalation, and human handoff.
- Own agent orchestration end to end using LangGraph/LangChain (or equivalent frameworks), including state management, guardrails, and failure recovery.
- Integrate agents with our core service layer: existing Java/Spring microservices, APIs, and event streams are the hands and feet of every agent you build.
- Build and tune the evaluation loop — automated evals, regression suites, trace analysis, and A/B measurement of agent quality.
- Work on the inference and serving layer: model routing, prompt/context management, and self-hosted serving with vLLM alongside commercial LLM APIs.
- Harden everything for a regulated, high-trust environment: PII handling, auditability, deterministic fallbacks, and observability.
Must-Have Qualifications
- 7+ years of software engineering experience, with senior/lead-level ownership of production systems.
- Proven hands-on delivery of LLM-based agentic systems in production — not coursework, not POCs. Expect to walk us through architecture, failure modes, and eval strategy of something you shipped.
- Strong Python (primary agent/ML stack) and Java (service integration) — both are daily-use languages here.
- Depth in the standard agent stack: LangChain, LangGraph, prompt/context engineering, tool/function calling, RAG pipelines.
- Working knowledge of PyTorch and model fundamentals — enough to fine-tune, debug model behavior, and reason about tradeoffs.
- Experience with LLM serving/inference — vLLM or comparable (TGI, TensorRT-LLM), plus commercial APIs (OpenAI, Anthropic, Bedrock/Vertex).
- Solid distributed-systems fundamentals: APIs, queues, caching, observability, CI/CD.
Major Plus
- Hands-on experience with agent-builder platforms such as Sierra or Decagon — deploying, extending, or evaluating them for customer-service use cases.
- Voice agents, real-time/streaming inference, or contact-center integration.
- Experience in regulated industries (finance, healthcare) — model risk, compliance review, audit trails.
- Eval frameworks (LangSmith, Braintrust, custom harnesses) and LLM safety/guardrail tooling.
Responsibilities
- Design and build production agentic workflows for customer-facing use cases
- Own agent orchestration end to end using LangGraph/LangChain
- Integrate agents with core service layer including Java/Spring microservices
- Build and tune the evaluation loop for agent quality
- Work on the inference and serving layer for model routing and management
- Harden systems for a regulated, high-trust environment
Qualifications
- 7+ years of software engineering experience
- Proven hands-on delivery of LLM-based agentic systems in production
- Strong Python and Java skills
- Depth in the standard agent stack including LangChain and LangGraph
- Working knowledge of PyTorch and model fundamentals
- Experience with LLM serving/inference
Skills mentioned
About Mindlance
Mindlance is a global Talent, Teams, Projects, and Workforce Solutions partner, serving leading enterprises across industries since 1999. With a 5,000 strong footprint across multiple countries, we deliver scalable, AI native solutions that help organizations build, optimize, and transform their workforce. Our capabilities include: • Talent Services: Contingent Staffing, Direct Sourcing, Perm / RPO • Teams: Managed Capacity, Global Remote Teams, and Early Talent Recruit Train Deploy • Projects: Outcome-based IT project solutions and BPO services • Workforce Solutions: Proprietary platforms for talent and workforce orchestration – leveraging enriched talent data, AI model training, and agentic automation Backed by 600+ specialized delivery experts and deep partnerships across MSP, enterprise workforce programs, and major data/cloud/software ecosystems, we also provide direct Managed SOW services with scalable teams and outcome based delivery. With ~$400M in annual revenue, Mindlance continues to grow through a mindful commitment to balance and to aligning people, performance, partnership, and purpose. SIA Recognitions: Largest U.S. Staffing Firms • Largest IT Staffing Firms • Largest Life Sciences Staffing Firms • Fastest Growing U.S. Staffing Firms • Largest Diversity Owned U.S. Staffing Firms Learn more at www.mindlance.com