Principal AI Software Engineer

Selby Jennings
Remote, USFull-time$250,000–$300,000Posted Sep 16, 2026

About the role

Principal AI Software Engineer

Remote, US

Full-Time

A leading financial services organization is seeking a Principal AI Software Engineer to help define and build the next generation of AI-powered products, intelligent workflows, and internal AI platforms. This is a high impact individual contributor role focused on taking AI initiatives from concept to production while partnering closely with stakeholders internally as well as external clients.

What You'll Be Doing:

Build and deploy production-grade AI applications and agentic workflows.

Design scalable backend services and AI platform capabilities that can be leveraged across multiple teams.

Develop systems utilizing LLMs, RAG, embeddings, vector search, agent frameworks, and workflow orchestration.

Establish best practices for AI evaluation, observability, testing, reliability, and governance.

Drive technical architecture decisions and mentor engineers across the organization.

Partner with stakeholders to identify high-impact opportunities for AI-driven automation and decision support.

What We're Looking For:

12+ years of software engineering experience.

Deep expertise in Python and backend application development.

Proven track record building and scaling production AI/ML systems.

Hands-on production experience with LLMs, agentic AI, RAG, embeddings, model evaluation, and modern AI frameworks.

Strong system design and architecture experience.

Excellent communication and stakeholder management skills. This role requires frequent collaboration with technical and non-technical teams and the ability to translate complex concepts into business value.

Prior experience in financial services, fintech, capital markets, real estate technology, or other highly regulated industries is a plus.

Additional Information:

Base salary targeted at $250,000 - $300,000 plus discretionary bonus.

Applicants must be authorized to work in the United States. Visa sponsorship is not available for this position.

If you're interested in building production AI systems with significant ownership and business impact, apply now!

*No contractors*

Responsibilities

  • Build and deploy production-grade AI applications and agentic workflows.
  • Design scalable backend services and AI platform capabilities that can be leveraged across multiple teams.
  • Develop systems utilizing LLMs, RAG, embeddings, vector search, agent frameworks, and workflow orchestration.
  • Establish best practices for AI evaluation, observability, testing, reliability, and governance.
  • Drive technical architecture decisions and mentor engineers across the organization.
  • Partner with stakeholders to identify high-impact opportunities for AI-driven automation and decision support.

Qualifications

  • 12+ years of software engineering experience.
  • Deep expertise in Python and backend application development.
  • Proven track record building and scaling production AI/ML systems.
  • Hands-on production experience with LLMs, agentic AI, RAG, embeddings, model evaluation, and modern AI frameworks.
  • Strong system design and architecture experience.
  • Excellent communication and stakeholder management skills.

Benefits

  • Base salary targeted at $250,000 - $300,000 plus discretionary bonus.

Skills mentioned

PythonBackend DevelopmentSystem DesignGenerative AILarge Language ModelsRetrieval-Augmented GenerationAI AgentsEmbeddingsModel EvaluationModel Deployment

About Selby Jennings

From Investment Banking, Risk Management, Quantitative Trading, and Insurance, to Investment Management, Sales & Trading, Technology, and Wealth Management, Selby Jennings supports the world’s largest financial institutions to revolutionary fintech start-ups with all their hiring needs as a leading Financial Sciences and Services talent partner.  If you would like to talk to us about your current talent needs, please request a call back here and one of our specialist consultants will call you back to discuss your hiring needs: https://www.selbyjennings.com/request-a-call-back

Professional Services1,001-5,000 employeesLondon, Greater London