Applied AI Engineer

Haystack
United StatesFull-timePosted Aug 30, 2026

About the role

A global technology powerhouse is seeking an Applied AI Engineer to join their team. This company is at the forefront of integrating artificial intelligence into core product workflows, aiming to revolutionize decision-making and automation across various industries.

The Role

Design, build, and optimize AI-powered features integrated directly into product workflows.

Develop and implement LLM-based interactions, prompts, and structured AI outputs for production.

Evaluate model performance using real-world data and feedback loops.

Improve AI output reliability through guardrails, fallback logic, and validation layers.

Collaborate closely with engineering, product, and design teams to deliver end-to-end AI features.

Contribute to the overall AI system design, focusing on usability and real-world impact.

What You'll Need

Strong software engineering background in production environments.

Proven experience with Artificial Intelligence (AI) and LLMs (e.g., OpenAI, Anthropic).

Familiarity with prompt engineering, structured outputs, and tool use patterns.

Experience building or integrating AI features into real products.

Strong understanding of API-based system integration and critical evaluation of AI outputs.

Comfort working in fast-paced, globally distributed teams with a strong product sense.

What's On Offer

Opportunity to work on cutting-edge AI features with significant real-world impact.

Fully remote position within a global engineering team.

Competitive benefits package including medical, dental, vision, and savings plan options.

Apply via Haystack today!

Responsibilities

  • Design, build, and optimize AI-powered features integrated directly into product workflows
  • Develop and implement LLM-based interactions, prompts, and structured AI outputs for production
  • Evaluate model performance using real-world data and feedback loops
  • Improve AI output reliability through guardrails, fallback logic, and validation layers
  • Collaborate closely with engineering, product, and design teams to deliver end-to-end AI features
  • Contribute to the overall AI system design, focusing on usability and real-world impact

Qualifications

  • Strong software engineering background in production environments
  • Proven experience with Artificial Intelligence (AI) and LLMs (e.g., OpenAI, Anthropic)
  • Familiarity with prompt engineering, structured outputs, and tool use patterns
  • Experience building or integrating AI features into real products
  • Strong understanding of API-based system integration and critical evaluation of AI outputs
  • Comfort working in fast-paced, globally distributed teams with a strong product sense

Benefits

  • Opportunity to work on cutting-edge AI features with significant real-world impact
  • Fully remote position within a global engineering team
  • Competitive benefits package including medical, dental, vision, and savings plan options

Skills mentioned

Generative AILarge Language ModelsPrompt EngineeringTool CallingAI AgentsModel EvaluationAPI IntegrationSystem DesignModel DeploymentSoftware Testing

About Haystack

Haystack combines AI & expert vetting to deliver world-class tech candidates who are engaged, aligned, and ready to interview. We're trusted by over 400,000+ tech candidates, working in Software Engineering, Data, Design, DevOps, Cloud, Tech Management, Testing, Product & Delivery, Architecture and more. 100s of employers from startups and scale-ups like Atom Bank, DuckDuckGo and Goodlord to established enterprises like American Express, Dunelm and AWS use Haystack to connect with qualified tech talent that they can't find anywhere else.

Technology51-200 employeesNewcastle upon Tyne, England