AI Engineer
HaystackAbout the role
We are working with a pioneering technology company at the forefront of AI and engineering, transforming industry platforms and driving significant innovation to enhance member success. This organization is dedicated to reimagining operations and processes critical to its business, from underwriting to risk management, by leveraging cutting-edge engineering to build, deploy, and operate integrated solutions across software, data, AI, and cloud infrastructure.
The Role
Join a hands-on, delivery-oriented team focused on shipping production pipelines, APIs, agents, and containerized services.
Build and operationalize LLM-enabled products including copilots, knowledge assistants, and agentic workflows.
Implement RAG, knowledge base, and document intelligence patterns end-to-end.
Deliver governed data and features for ML and GenAI, supporting training workflows and real-time inference.
Implement trust, safety, and governance controls, ensuring auditable, explainable, and compliant AI outputs.
Drive CI/CD, testing, versioning, and deployment standards across AI systems.
What You'll Need
5+ years of professional software engineering experience, with at least 1 year building and operating AI/ML systems in production.
Proven hands-on experience with LLMs: prompt engineering, RAG pipelines, fine-tuning, function/tool calling, and agent orchestration.
Strong Python engineering skills, capable of writing clean, maintainable, production-grade code.
Experience with AI/ML infrastructure: Databricks workflows, vector search, feature pipelines, Docker, and cloud-native deployment.
Familiarity with cloud-native AI workloads on AWS, including cost governance and performance tuning.
Experience implementing trust, safety, and governance controls (PII handling, content filtering, access controls).
What's On Offer
Opportunity to make a significant impact on member success through transformative technology.
Work with cutting-edge technologies like Claude Code, OpenAI Codex, GitHub Copilot, and AWS AI services.
Collaborate with diverse teams across Engineering, Product, Data Science, and business operations.
A delivery-oriented environment that values shipping, measuring, and iterating on solutions.
Apply via Haystack today!
Responsibilities
- Join a hands-on, delivery-oriented team focused on shipping production pipelines, APIs, agents, and containerized services
- Build and operationalize LLM-enabled products including copilots, knowledge assistants, and agentic workflows
- Implement RAG, knowledge base, and document intelligence patterns end-to-end
- Deliver governed data and features for ML and GenAI, supporting training workflows and real-time inference
- Implement trust, safety, and governance controls, ensuring auditable, explainable, and compliant AI outputs
- Drive CI/CD, testing, versioning, and deployment standards across AI systems
Qualifications
- 5+ years of professional software engineering experience, with at least 1 year building and operating AI/ML systems in production
- Proven hands-on experience with LLMs: prompt engineering, RAG pipelines, fine-tuning, function/tool calling, and agent orchestration
- Strong Python engineering skills, capable of writing clean, maintainable, production-grade code
- Experience with AI/ML infrastructure: Databricks workflows, vector search, feature pipelines, Docker, and cloud-native deployment
- Familiarity with cloud-native AI workloads on AWS, including cost governance and performance tuning
- Experience implementing trust, safety, and governance controls (PII handling, content filtering, access controls)
Benefits
- Opportunity to make a significant impact on member success through transformative technology
- Work with cutting-edge technologies like Claude Code, OpenAI Codex, GitHub Copilot, and AWS AI services
- Collaborate with diverse teams across Engineering, Product, Data Science, and business operations
- A delivery-oriented environment that values shipping, measuring, and iterating on solutions
Skills mentioned
About Haystack
Haystack combines AI & expert vetting to deliver world-class tech candidates who are engaged, aligned, and ready to interview. We're trusted by over 400,000+ tech candidates, working in Software Engineering, Data, Design, DevOps, Cloud, Tech Management, Testing, Product & Delivery, Architecture and more. 100s of employers from startups and scale-ups like Atom Bank, DuckDuckGo and Goodlord to established enterprises like American Express, Dunelm and AWS use Haystack to connect with qualified tech talent that they can't find anywhere else.