Staff Software Engineer, AI Agent Architecture for Google Cloud Business Platforms

Google

Sunnyvale, California, United StatesFull-time$207,000–$300,000Posted Oct 22, 2026

About the role

MINIMUM QUALIFICATIONS:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products, and 3 years

of experience with software design and architecture.

  • 5 years of experience leading ML design and optimizing end-to-end Machine

Learning (e.g., model deployment, model evaluation, data processing,

debugging, fine tuning).

  • 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large

Vision Models) or with GenAI-related concepts (language modeling, computer

vision).

  • Experience in AI Platforms/Gen AI Agents and Large-scale Distributed Systems.

PREFERRED QUALIFICATIONS:

  • Master’s degree or PhD in Engineering, Computer Science, or a related

technical field.

  • 8 years of experience with data structures/algorithms.
  • 3 years of experience in a technical leadership role leading project teams

and setting technical direction.

  • 3 years of experience working in a complex, matrixed organization involving

cross-functional, or cross-business projects.

  • Experience with HITL workflows, rater feedback loops, automated

evaluation/auto-raters, or model distillation pipelines.

  • Experience with Google Cloud Platform technologies.

ABOUT THE JOB:

Google's software engineers develop the next-generation technologies that change

how billions of users connect, explore, and interact with information and one

another. Our products need to handle information at massive scale, and extend

well beyond web search. We're looking for engineers who bring fresh ideas from

all areas, including information retrieval, distributed computing, large-scale

system design, networking and data storage, security, artificial intelligence,

natural language processing, UI design and mobile; the list goes on and is

growing every day. As a software engineer, you will work on a specific project

critical to Google’s needs with opportunities to switch teams and projects as

you and our fast-paced business grow and evolve. We need our engineers to be

versatile, display leadership qualities and be enthusiastic to take on new

problems across the full-stack as we continue to push technology forward.

With your technical expertise you will manage project priorities, deadlines, and

deliverables. You will design, develop, test, deploy, maintain, and enhance

software solutions.

As a tech lead, you will lead the architecture and development of EGI Foundry

(Enterprise AI Platforms and Agent Architecture.) —our platform for building,

composing, and operationalizing enterprise intelligence applications (adapting

modern AI platform paradigms to Google's enterprise scale). You will design deep

ontology to model enterprise workflows, documents, and data entities, enabling

agents to reason over complex enterprise contexts with high fidelity.

You will manage fundamental challenges at the intersection of large-scale

systems and generative AI: from architecting agent composition frameworks and

generative UIs to designing automated learning loops that continuously improve

agent accuracy from human operator feedback.

Google Cloud accelerates every organization’s ability to digitally transform its

business and industry. We deliver enterprise-grade solutions that leverage

Google’s cutting-edge technology, and tools that help developers build more

sustainably. Customers in more than 200 countries and territories turn to Google

Cloud as their trusted partner to enable growth and solve their most critical

business problems.

Individual pay is determined by factors including job-related skills,

experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

Learn more about benefits at Google

[https://www.google.com/about/careers/applications/benefits/].

RESPONSIBILITIES:

  • Lead the technical design and implementation of EGI Foundry, providing the

foundation, runtime, and interfaces for rapidly developing, deploying, and

orchestrating enterprise AI applications.

  • Architect graph representations, property graph libraries, and ontology

services (including GoogleSQL graph integration) to model enterprise

processes, document relationships, and system understanding for multi-agent

workflows.

  • Partner on next-generation Human-in-the-Loop (HITL) frameworks, designing

feedback loops that automatically convert human corrections into improved

prompts, fine-tuning datasets, and verification benchmarks for hard-to-verify

tasks.

  • Build robust, low-latency, and compliant integration points with core Cloud

and Alphabet systems (Salesforce, SAP, Vertex AI, Gemini Enterprise).

  • Set technical direction, author high-impact design docs, lead architecture

reviews, and mentor engineers. Collaborate with partners including Cloud AI,

Core Data Insights, and Finance Engineering.

Responsibilities

  • Lead the design and implementation of the EGI Foundry platform for developing, deploying, and orchestrating enterprise AI applications.
  • Architect graph representations, property graph libraries, and ontology services for enterprise workflows and multi-agent systems.
  • Design human-in-the-loop feedback frameworks that improve prompts, training data, and verification benchmarks.
  • Build low-latency, compliant integrations with Cloud and Alphabet systems.
  • Set technical direction, lead architecture reviews, author design documents, and mentor engineers.

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • At least 8 years of software development experience.
  • At least 5 years of experience testing and launching software products, and 3 years in software design and architecture.
  • At least 5 years leading machine learning design and optimizing end-to-end ML systems.
  • At least 2 years of experience with generative AI techniques or related concepts.
  • Experience with AI platforms, generative AI agents, and large-scale distributed systems.
  • Preferred: Master's degree or PhD in a related technical field; experience with data structures and algorithms, technical leadership, complex cross-functional organizations, human-in-the-loop workflows, and Google Cloud Platform.

Benefits

  • 20% bonus target
  • Equity
  • Benefits

Skills mentioned

System DesignDistributed SystemsMachine LearningGenerative AILarge Language ModelsAI AgentsModel DeploymentModel EvaluationGoogle CloudAPI Integration

About Google

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone. Check out our career opportunities at goo.gle/3DLEokh

Software Development10,001+ employeesMountain View, CA

H-1B sponsorship history

Historical employer filing data was found for Google. The employer record includes 57,181 historical certified applications. This is employer-level history, not a guarantee that this role currently offers sponsorship.