ML Engineer
New York, New York, United StatesunknownPosted Aug 30, 2026
About the role
We're hiring on behalf of a Haystack partner!
The Role
- Architect and lead the delivery of production-grade AI systems leveraging agentic frameworks, RAG, and LLM orchestration.
- Own the technical vision for a multi-agent ecosystem, including pipeline orchestration engines, embedding/vectorization strategies, and knowledge retrieval systems.
- Lead a team of engineers in building autonomous AI pipelines for complex document processing.
- Drive build-vs-buy decisions for the AI toolchain and establish scalable prompt engineering patterns.
- Implement core agentic components and build embedding pipelines for document intelligence.
- Own CI/CD pipelines, containerized deployments, and define observability for AI systems.
What You'll Need
- Bachelor's or advanced degree in computer science, engineering, or equivalent experience.
- 10+ years of professional software engineering experience, with 3+ years in technical leadership or mentoring.
- Deep expertise in LLM orchestration, RAG architectures, and agentic patterns.
- Strong proficiency in Python (FastAPI, async/await) and solid experience with Java (Spring Boot).
- Proven experience in delivering production AI systems with robust observability and error recovery.
- Experience with document intelligence, including NLP and structured extraction from unstructured text.
What's On Offer
- Competitive salary
- Opportunity to build custom agent frameworks and contribute to greenfield AI initiatives.
- Lead and mentor a talented team of AI/ML, backend, and full-stack engineers.
- Work with cutting-edge AI technologies in a leading global financial services company.
Apply via Haystack today!
Responsibilities
- Architect and lead the delivery of production-grade AI systems
- Own the technical vision for a multi-agent ecosystem
- Lead a team of engineers in building autonomous AI pipelines
- Drive build-vs-buy decisions for the AI toolchain
- Implement core agentic components and build embedding pipelines
- Own CI/CD pipelines and define observability for AI systems
Qualifications
- Bachelor's or advanced degree in computer science, engineering, or equivalent experience
- 10+ years of professional software engineering experience
- 3+ years in technical leadership or mentoring
- Deep expertise in LLM orchestration and RAG architectures
- Strong proficiency in Python and solid experience with Java
- Proven experience in delivering production AI systems
Benefits
- Competitive salary
- Opportunity to build custom agent frameworks
- Lead and mentor a talented team
- Work with cutting-edge AI technologies
Skills mentioned
PythonFastAPIJavaSpring BootLarge Language ModelsRetrieval-Augmented GenerationAI AgentsEmbeddingsPrompt EngineeringCI/CD
About Haystack
Haystack combines AI & expert vetting to deliver world-class tech candidates who are engaged, aligned, and ready to interview. We're trusted by over 400,000+ tech candidates, working in Software Engineering, Data, Design, DevOps, Cloud, Tech Management, Testing, Product & Delivery, Architecture and more. 100s of employers from startups and scale-ups like Atom Bank, DuckDuckGo and Goodlord to established enterprises like American Express, Dunelm and AWS use Haystack to connect with qualified tech talent that they can't find anywhere else.
Technology51-200 employeesNewcastle upon Tyne, England