Applied AI Engineer
HaystackAbout the role
We are partnering with a pioneering technology company that is at the forefront of designing and deploying cutting-edge AI solutions, transforming how businesses leverage large language models and intelligent agents.
The Role
Design, build, evaluate, and productionize LLM-powered agents and AI workflows using AWS-native platforms.
Implement and leverage Amazon Bedrock capabilities, including Bedrock Agents, Knowledge Bases, and various foundation models.
Develop agentic workflows incorporating RAG, tool/function calling, APIs, and enterprise data sources.
Integrate AI agents with enterprise applications and data using AWS services such as Lambda, Step Functions, SQS/SNS, and API Gateway.
Build and maintain robust LLM evaluation suites and implement prompt/context engineering for reliable production behavior.
Collaborate directly with business users to rapidly iterate on solutions and deliver production-ready functionality.
What You'll Need
8+ years of software engineering experience, with at least 2.5+ years building production LLM applications.
Strong programming skills in Python and/or TypeScript, coupled with strong API engineering experience.
Hands-on experience with prompt engineering, context engineering, and LLM evaluation approaches (golden datasets, LLM-as-a-judge).
Practical experience with AWS, ideally including Amazon Bedrock, or strong experience with OpenAI/Anthropic APIs combined with AWS.
Ability to work full Pacific Time (PST/PDT) business hours.
Strong information-retrieval/RAG experience, including chunking, embeddings, hybrid search, and re-ranking.
What's On Offer
Opportunity to work on innovative, production-focused AI systems rather than just prototypes.
Engage with advanced AWS technologies, including Amazon Bedrock, to solve complex business challenges.
Contribute to a collaborative environment focused on reliable, observable, and measurable AI applications.
Apply via Haystack today!
Responsibilities
- Design, build, evaluate, and productionize LLM-powered agents and AI workflows using AWS-native platforms
- Implement and leverage Amazon Bedrock capabilities, including Bedrock Agents and Knowledge Bases
- Develop agentic workflows incorporating RAG, tool/function calling, APIs, and enterprise data sources
- Integrate AI agents with enterprise applications and data using AWS services
- Build and maintain robust LLM evaluation suites and implement prompt/context engineering
- Collaborate directly with business users to rapidly iterate on solutions
Qualifications
- 8+ years of software engineering experience
- At least 2.5+ years building production LLM applications
- Strong programming skills in Python and/or TypeScript
- Hands-on experience with prompt engineering and LLM evaluation approaches
- Practical experience with AWS, ideally including Amazon Bedrock
Benefits
- Opportunity to work on innovative, production-focused AI systems
- Engage with advanced AWS technologies
- Contribute to a collaborative environment
Skills mentioned
About Haystack
Haystack combines AI & expert vetting to deliver world-class tech candidates who are engaged, aligned, and ready to interview. We're trusted by over 400,000+ tech candidates, working in Software Engineering, Data, Design, DevOps, Cloud, Tech Management, Testing, Product & Delivery, Architecture and more. 100s of employers from startups and scale-ups like Atom Bank, DuckDuckGo and Goodlord to established enterprises like American Express, Dunelm and AWS use Haystack to connect with qualified tech talent that they can't find anywhere else.