Applied AI Engineer

Haystack
Trenton, New Jersey, United StatesFull-timePosted Aug 26, 2026

About the role

A world-leading technology company specializing in innovative AI solutions is seeking a skilled professional to join their dynamic team.

This organisation is at the forefront of developing cutting-edge AI-powered agents and workflows, leveraging state-of-the-art platforms to deliver reliable and impactful business solutions.

The Role

Design, build, evaluate, and productionize LLM-powered agents and AI workflows.

Develop reliable AI systems for business use cases on an AWS-native platform, utilizing Amazon Bedrock as the foundation-model layer.

Work within standardized platform templates, CI/CD pipelines, guardrails, and evaluation frameworks.

Build and maintain LLM evaluation suites as an integral part of the engineering lifecycle.

Implement prompt and context engineering strategies for reliable production behavior.

Integrate AI agents with enterprise applications and data through APIs and AWS services (Lambda, Step Functions, SQS/SNS, API Gateway).

What You'll Need

8+ years of software engineering experience.

At least 2.5+ years of experience building production LLM applications, including agents, RAG pipelines, and tool/function calling.

Strong programming skills in Python and/or TypeScript.

Strong API engineering experience (design, versioning, authentication, error handling).

Hands-on experience developing LLM evaluation approaches (golden datasets, LLM-as-a-judge, regression suites).

Practical experience with prompt engineering, context engineering, and AWS.

What's On Offer

Opportunity to work on cutting-edge AI systems and LLM applications.

Collaborate directly with business users to deliver production functionality.

Be part of a team transforming business use cases into reliable AI solutions.

Apply via Haystack today!

Responsibilities

  • Design, build, evaluate, and productionize LLM-powered agents and AI workflows
  • Develop reliable AI systems for business use cases on an AWS-native platform
  • Work within standardized platform templates, CI/CD pipelines, guardrails, and evaluation frameworks
  • Build and maintain LLM evaluation suites as part of the engineering lifecycle
  • Implement prompt and context engineering strategies for reliable production behavior
  • Integrate AI agents with enterprise applications and data through APIs and AWS services

Qualifications

  • 8+ years of software engineering experience
  • At least 2.5+ years of experience building production LLM applications
  • Strong programming skills in Python and/or TypeScript
  • Strong API engineering experience
  • Hands-on experience developing LLM evaluation approaches
  • Practical experience with prompt engineering, context engineering, and AWS

Benefits

  • Opportunity to work on cutting-edge AI systems and LLM applications
  • Collaborate directly with business users to deliver production functionality
  • Be part of a team transforming business use cases into reliable AI solutions

Skills mentioned

PythonTypeScriptAWSGenerative AILarge Language ModelsAI AgentsRetrieval-Augmented GenerationPrompt EngineeringTool CallingModel Evaluation

About Haystack

Haystack combines AI & expert vetting to deliver world-class tech candidates who are engaged, aligned, and ready to interview. We're trusted by over 400,000+ tech candidates, working in Software Engineering, Data, Design, DevOps, Cloud, Tech Management, Testing, Product & Delivery, Architecture and more. 100s of employers from startups and scale-ups like Atom Bank, DuckDuckGo and Goodlord to established enterprises like American Express, Dunelm and AWS use Haystack to connect with qualified tech talent that they can't find anywhere else.

Technology51-200 employeesNewcastle upon Tyne, England