Senior AI Engineer
Capital OneAbout the role
Home/Jobs/Senior AI Engineer
Senior AI Engineer
Capital One
New York / San Jose
3+ years
Today
$195.2K–242.2K/yr
Full-time
Onsite
Skills Required
LLM
Hugging Face
Vector Database
LLM Inference
Machine Learning
AI
Python
Go
Scala
Java
AWS
GCP
Azure
Nemo Guardrails
PyTorch
Description
Capital One is hiring a Senior AI Engineer to help build responsible, reliable AI systems for banking. The role sits on the Intelligent Foundations and Experiences team and focuses on scalable, high-performance AI infrastructure and products.
Company: Capital One
Role: Senior AI Engineer
Location: McLean, Virginia, United States
Experience
Bachelor's degree plus at least 3 years of experience developing AI and ML algorithms or technologies, or master's degree plus at least 1 year
At least 3 years of experience programming with Python, Go, Scala, or Java
4 years of experience deploying scalable and responsible AI solutions on cloud platforms
Passion for staying current with the latest research and applying novel techniques in production
Ability to adapt quickly, bring clarity to undefined problems, and articulate findings concisely
Strong foundation in engineering and mathematics
Deep technical expertise across hardware, software, and AI
Qualification
Bachelor's degree in computer science, AI, electrical engineering, computer engineering, or related fields
Master's degree in computer science, AI, electrical engineering, computer engineering, or related fields
Responsibilities
Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
Design, develop, test, deploy, and support AI software components
Build foundation model training and large language model inference capabilities
Implement similarity search, guardrails, model evaluation, experimentation, governance, and observability
Leverage open source and SaaS AI technologies
Introduce state-of-the-art LLM optimization techniques
Improve scalability, cost, latency, and throughput of production AI systems
Contribute to the technical vision and long-term roadmap of foundational AI systems
Build proprietary solutions that serve teams across Capital One and deliver value to millions of customers
Additional Responsibilities
Work on responsible and scalable AI systems
Help reimagine how Capital One serves customers and businesses
Support AI models and platforms that empower internal teams to enhance their products with AI
Nice To Have
Experience developing, delivering, and supporting AI services
Experience developing AI and ML algorithms or technologies using Python, C++, C#, Java, or Golang
Experience applying state-of-the-art techniques for optimizing training and inference software
Experience improving hardware utilization
Experience improving latency, throughput, and cost
Employment authorization sponsorship may be considered for a qualified applicant
More Skills
foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, observability, AWS UltraClusters, C++, C#, private cloud
Prepare for this role
Recommended resources to build the skills for this position. Sponsored.
Top 20 LLM System Design Questions (Quick)
Zenaique
A focused LLM system design interview question set.
Top 50 LLM System Design Interview Questions
Zenaique
Curated LLM system design questions from Zenaique.
Top 20 Vector Databases Questions (Quick)
Zenaique
A focused vector-database interview question set from Zenaique.
More LLM jobs
AI Products
Solv
San Francisco
Today
Agentic AI Developer
Booz Allen
United State
Today
Agentic AI Developer
Booz Allen
O'Fallon
Today
Azure Foundry ML and AI Engineer
Visionyle
Hyderabad
Today
Sr Associate Software Engineer - Gen AI
Amgen
Hyderabad
Today
Gen AI - Manager
EY
Mumbai
Today
Responsibilities
- Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
- Design, develop, test, deploy, and support AI software components
- Build foundation model training and large language model inference capabilities
- Implement similarity search, guardrails, model evaluation, experimentation, governance, and observability
- Leverage open source and SaaS AI technologies
- Introduce state-of-the-art LLM optimization techniques
- Improve scalability, cost, latency, and throughput of production AI systems
- Contribute to the technical vision and long-term roadmap of foundational AI systems
Qualifications
- Bachelor's degree in computer science, AI, electrical engineering, computer engineering, or related fields
- Master's degree in computer science, AI, electrical engineering, computer engineering, or related fields
Skills mentioned
About Capital One
TopGenAIJobs is a curated job board for the generative AI ecosystem — LLM engineers, ML researchers, RAG developers, prompt engineers, AI product managers, and the full stack of roles building the next generation of AI products. Every listing is hand reviewed before going live. For candidates: free to search, filter by skill (LangChain, PyTorch, AWS, etc.), location, and work mode. Save jobs, get alerts, prepare with curated learning resources for each role. For employers: post free, boost for premium placement when you want extra visibility. Reach a candidate pool that's specifically there to work on AI. Visit topgenaijobs.com to browse the latest roles.