Lead Software Engineer

About the role

About The Company

J.P. Morgan is a globally renowned financial institution with a history spanning over two centuries. As a leader in the financial services sector, J.P. Morgan offers a comprehensive range of solutions including investment banking, asset management, commercial banking, and financial transaction processing. The company is committed to innovation, excellence, and delivering value to its clients across the globe. With a strong emphasis on integrity and client-centricity, J.P. Morgan continuously strives to set industry standards through technological advancement and strategic growth. Its diverse and talented workforce is integral to maintaining its position as a trusted partner for individuals, corporations, and governments worldwide.

About The Role

We are seeking a highly skilled Lead Software Engineer specializing in Python, Pyspark, Java, and Big Data technologies to join our Asset and Wealth Management division within the Global Prime Brokerage Team. This pivotal role involves leading the development and modernization of data engineering and analytics platforms, with a focus on AI-driven data products and autonomous agents. As a core member of our agile team, you will be responsible for designing scalable solutions that enhance data governance, quality, and lineage, supporting regulatory compliance and strategic business initiatives. Your expertise will drive the transformation towards a data mesh architecture, enabling self-service analytics and improving operational efficiencies. You will collaborate closely with stakeholders across multiple domains, providing technical leadership and fostering an environment of innovation and continuous improvement.

Qualifications

The ideal candidate will have at least five years of professional experience in software engineering, with proven leadership in delivering AI-first analytics and data engineering at scale. Formal training or certification in software engineering principles is essential. Candidates should possess deep hands-on expertise with big data platforms such as Spark, Databricks, Snowflake, and Iceberg, along with proficiency in programming languages including Python, PySpark, and Java. Strong knowledge of data ingestion, transformation processes, and data governance frameworks is required. Experience with ML pipelines, NLP, LLMs, and autonomous agent frameworks is highly desirable. Candidates must demonstrate excellent communication skills, the ability to work collaboratively in an agile environment, and a solid understanding of responsible AI practices, security, and compliance standards.

Responsibilities

Collaborate with business and technology teams to develop innovative AI-first analytics and data product solutions that meet strategic objectives.

Define and implement architecture standards for an AI-driven data product lifecycle, including semantic extraction, automated lineage, data quality, and self-service consumption.

Design, build, and operate autonomous data engineering agents capable of detecting schema drift, proposing transformations, reconciling semantics, and maintaining governance evidence within human-in-the-loop controls.

Develop analytics platforms capable of supporting real-time and batch reporting, exploring new ideas to enhance data insights and operational efficiency.

Establish comprehensive monitoring and alerting systems to ensure high performance, scalability, availability, and reliability of solutions.

Provide technical guidance and leadership to team members, fostering best practices and promoting the adoption of enterprise AI-assisted development tools.

Lead modernization efforts by migrating legacy analytics and reporting systems to a unified data mesh ecosystem, reducing data fragmentation and duplication.

Implement ML/LLM solutions for entity resolution and parent identification, standardizing analytical product packaging for reuse and monetization.

Embed governance, lineage, and data quality controls into all phases of data processing to enhance auditability and regulatory compliance.

Benefits

J.P. Morgan offers a competitive total rewards package that includes a base salary commensurate with experience, skill set, and location. Eligible employees may also receive performance-based incentives, including cash bonuses and equity awards, recognizing individual and team contributions. The company provides a comprehensive benefits portfolio, including health care coverage, wellness programs, retirement plans, backup childcare, tuition reimbursement, mental health support, and financial coaching. Additional benefits are tailored to meet diverse employee needs, fostering a supportive and inclusive work environment. J.P. Morgan is committed to investing in its employees’ growth and well-being, ensuring they have the resources to thrive both professionally and personally.

Equal Opportunity

J.P. Morgan is an equal opportunity employer that values diversity and inclusion in the workplace. The company does not discriminate based on race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy, disability, or any other protected attribute under applicable law. Reasonable accommodations are provided for applicants and employees to support their religious practices, mental health, or physical disabilities. J.P. Morgan is committed to fostering an inclusive environment where all employees can succeed and contribute to the company's ongoing success.