AI Engineer – Generative AI & Product Engineering
Northern Trust
About the role
About Northern Trust
As a global leader in innovative wealth management, asset servicing, asset management and banking services, Northern Trust (Nasdaq: NTRS) is proud to guide the world’s most successful individuals, families, corporations and institutions.
Since 1889, we have aligned our efforts with our three guiding Principles That Endure: Service, Expertise, and Integrity. Together, they reflect the three cornerstones of business conduct which we strive to instill in our employees, whom we call partners, and to provide to our clients and the communities we serve worldwide.
With more than 135 years of financial experience and over 24,000 partners, we serve the world’s most sophisticated clients using leading technology and exceptional service.
Job Description: AI Engineer – Generative AI & Product Engineering
Role Overview
We are seeking a hands-on AI Engineer with strong product development experience to design, build, and deploy enterprise-grade Generative AI solutions. The ideal candidate combines expertise in LLMs, RAG, agentic AI, Python, Azure, and cloud-native engineering with a product mindset focused on scalability, reliability, security, and user experience.
The engineer will work across the full product lifecycle, from architecture and prototyping through API development, deployment, evaluation, monitoring, and production support.
Key Responsibilities
Design and develop enterprise Generative AI and agentic AI applications using LangChain/LangSmith and LangGraph.
Build multi-step and stateful AI workflows involving reasoning, tool integration, retrieval, and human-in-the-loop patterns.
Develop Retrieval-Augmented Generation (RAG) solutions using PostgreSQL and pgvector for vector storage and semantic retrieval.
Integrate applications with Azure OpenAI and other LLM-based services.
Design effective prompts and reusable prompt patterns using advanced prompt engineering techniques.
Build scalable backend services and REST APIs using Python and FastAPI.
Develop evaluation and observability mechanisms for measuring AI response quality, latency, reliability, and retrieval effectiveness.
Use LangSmith for tracing, evaluation, debugging, and observability of LLM/agent workflows.
Containerize and deploy AI services to Azure Kubernetes Service (AKS).
Design solutions using appropriate Azure services for identity, security, networking, storage, monitoring, and application integration.
Implement production-ready practices including exception handling, logging, retries, API security, configuration management, and observability.
Work closely with product owners, architects, and engineering teams to convert business requirements into scalable AI product capabilities.
Participate in architecture/design reviews, code reviews, testing, deployment, troubleshooting, and ongoing product enhancement.
Evaluate emerging LLM, retrieval, agentic AI, and AI engineering techniques and apply them where they provide measurable product value.
Partner with application, infrastructure, cloud, database, and operations teams during major incidents and production issues to identify dependencies and resolve problems.
Required Technical Skills
Generative AI
Large Language Models (LLMs)
Azure OpenAI
Retrieval-Augmented Generation (RAG)
Prompt Engineering
Agentic AI / AI Agents
LLM evaluation and observability
AI Frameworks
LangChain
LangGraph
LangSmith
Application Engineering
Python
FastAPI
REST APIs
Async/API development
Microservices architecture
Data & Vector Search
PostgreSQL
pgvector
Vector embeddings
Semantic/vector search
RAG retrieval and indexing patterns
Cloud & Deployment
Microsoft Azure
Azure Kubernetes Service (AKS)
Containers/Docker
Cloud-native application development
CI/CD and production deployment practices
Product Development Experience
The candidate should demonstrate experience taking AI capabilities beyond proof-of-concept into production products, including:
Translating business requirements into technical product capabilities
Designing reusable and maintainable AI architectures
Balancing model quality, latency, cost, security, and scalability
Designing APIs and integration patterns for enterprise applications
Establishing AI evaluation and quality measures
Troubleshooting production LLM/RAG applications
Collaborating across engineering, architecture, product, QA, DevOps, and business teams
Owning features through design, development, testing, deployment, and production stabilization
Preferred Qualifications
Strong hands-on experience developing enterprise GenAI/RAG products
Experience building LangGraph-based agentic workflows
Hands-on experience with LangSmith tracing and evaluation
Experience deploying Python/FastAPI applications on AKS
Experience with PostgreSQL/pgvector at production scale
Understanding of LLM hallucination, grounding, context management, guardrails, and evaluation
Familiarity with Azure identity, secrets management, monitoring, and enterprise security patterns
Experience building internal developer, infrastructure, automation, operations, or knowledge-management AI products is a plus.
Salary Range:
$80,800 - 133,400 USD
Salary range is a good faith estimate of base pay. Northern Trust provides a comprehensive benefits package including retirement benefits (401k and pension), health and welfare benefits (medical, dental, vision, spending accounts and disability), paid time off, parental and caregiver leave, life & accident insurance, and other voluntary and well-being benefits. Northern Trust also provides a discretionary bonus program that may include an equity component.
Work Authorization
Applicants must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future. Northern Trust will not sponsor applicants for U.S. work visa status for this opportunity (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa).
Working with Us
As a Northern Trust partner, you will be part of a flexible and collaborative work culture, which has a strong history of financial strength and stability. Movement within the organization is encouraged, senior leaders are accessible, and you can take pride in working for a company committed to an inclusive workplace and assisting the communities we serve.
Philanthropy is deeply rooted in Northern Trust’s history and is an essential element of our culture. Employees around the world give their time and talent to work for the greater good of their communities.
Reasonable Accommodation
Northern Trust is committed to working with and providing adjustments to individuals with health conditions and disabilities. If you need a reasonable accommodation for any part of the employment process, please email our HR Service Center at MyHRHelp@ntrs.com, or alternatively you can discuss your individual requirements with the recruiter you are working with.
Responsibilities
- Design and build enterprise generative AI and agentic AI applications using LangChain, LangGraph, and Azure OpenAI.
- Develop stateful AI workflows and RAG solutions using PostgreSQL and pgvector.
- Build Python and FastAPI services, REST APIs, and cloud-native applications.
- Deploy and operate AI services on Azure Kubernetes Service.
- Implement AI evaluation, tracing, monitoring, security, and production reliability practices.
- Translate business requirements into scalable AI product capabilities and own features through deployment and production support.
- Collaborate with product, architecture, engineering, infrastructure, and operations teams.
Qualifications
- Hands-on experience building and deploying enterprise generative AI and RAG products.
- Knowledge of LLMs, prompt engineering, agentic AI, LangChain, LangGraph, and LangSmith.
- Proficiency in Python, FastAPI, REST APIs, and microservices.
- Experience with PostgreSQL, pgvector, embeddings, and semantic search.
- Experience with Microsoft Azure, AKS, containers, and production deployment practices.
- Ability to balance model quality, latency, cost, security, and scalability.
- Understanding of LLM grounding, hallucination mitigation, context management, guardrails, and evaluation.
Benefits
- 401(k) and pension retirement benefits
- Medical, dental, vision, spending account, and disability benefits
- Paid time off
- Parental and caregiver leave
- Life and accident insurance
- Voluntary and well-being benefits
- Discretionary bonus program that may include an equity component
Skills mentioned
About Northern Trust
Northern Trust Asset Management is a global investment manager that helps investors navigate changing market environments in efforts to realize their long-term objectives. Entrusted with US$1.4 trillion in assets under management as of March 31, 2026 we understand that investing ultimately serves a greater purpose and believe investors should be compensated for the risks they take — in all market environments and any investment strategy. That’s why we combine robust capital markets research, expert portfolio construction and comprehensive risk management to craft innovative and efficient solutions that seek to deliver targeted investment outcomes. As engaged contributors to our communities, we consider it a great privilege to serve our investors and our communities with integrity, respect and transparency. Northern Trust Asset Management is composed of Northern Trust Investments, Inc., Northern Trust Global Investments Limited, Northern Trust Fund Managers (Ireland) Limited, Northern Trust Global Investments Japan, K.K., NT Global Advisors, Inc., 50 South Capital Advisors, LLC, Northern Trust Asset Management Australia Pty Ltd, and investment personnel of The Northern Trust Company of Hong Kong Limited and The Northern Trust Company. © 2025 Northern Trust Corporation. Head Office: 50 South La Salle Street, Chicago, Illinois 60603 U.S.A.