Staff Software Engineer, AI Agent Architecture for Google Cloud Business Platforms
About the role
MINIMUM QUALIFICATIONS:
- Bachelor's degree or equivalent practical experience.
- 8 years of experience in software development.
- 5 years of experience testing, and launching software products, and 3 years
of experience with software design and architecture.
- 5 years of experience leading ML design and optimizing end-to-end Machine
Learning (e.g., model deployment, model evaluation, data processing,
debugging, fine tuning).
- 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large
Vision Models) or with GenAI-related concepts (language modeling, computer
vision).
- Experience in AI Platforms/Gen AI Agents and Large-scale Distributed Systems.
PREFERRED QUALIFICATIONS:
- Master’s degree or PhD in Engineering, Computer Science, or a related
technical field.
- 8 years of experience with data structures/algorithms.
- 3 years of experience in a technical leadership role leading project teams
and setting technical direction.
- 3 years of experience working in a complex, matrixed organization involving
cross-functional, or cross-business projects.
- Experience with HITL workflows, rater feedback loops, automated
evaluation/auto-raters, or model distillation pipelines.
- Experience with Google Cloud Platform technologies.
ABOUT THE JOB:
Google's software engineers develop the next-generation technologies that change
how billions of users connect, explore, and interact with information and one
another. Our products need to handle information at massive scale, and extend
well beyond web search. We're looking for engineers who bring fresh ideas from
all areas, including information retrieval, distributed computing, large-scale
system design, networking and data storage, security, artificial intelligence,
natural language processing, UI design and mobile; the list goes on and is
growing every day. As a software engineer, you will work on a specific project
critical to Google’s needs with opportunities to switch teams and projects as
you and our fast-paced business grow and evolve. We need our engineers to be
versatile, display leadership qualities and be enthusiastic to take on new
problems across the full-stack as we continue to push technology forward.
With your technical expertise you will manage project priorities, deadlines, and
deliverables. You will design, develop, test, deploy, maintain, and enhance
software solutions.
As a tech lead, you will lead the architecture and development of EGI Foundry
(Enterprise AI Platforms and Agent Architecture.) —our platform for building,
composing, and operationalizing enterprise intelligence applications (adapting
modern AI platform paradigms to Google's enterprise scale). You will design deep
ontology to model enterprise workflows, documents, and data entities, enabling
agents to reason over complex enterprise contexts with high fidelity.
You will manage fundamental challenges at the intersection of large-scale
systems and generative AI: from architecting agent composition frameworks and
generative UIs to designing automated learning loops that continuously improve
agent accuracy from human operator feedback.
Google Cloud accelerates every organization’s ability to digitally transform its
business and industry. We deliver enterprise-grade solutions that leverage
Google’s cutting-edge technology, and tools that help developers build more
sustainably. Customers in more than 200 countries and territories turn to Google
Cloud as their trusted partner to enable growth and solve their most critical
business problems.
Individual pay is determined by factors including job-related skills,
experience, and relevant education or training.
US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits
Learn more about benefits at Google
[https://www.google.com/about/careers/applications/benefits/].
RESPONSIBILITIES:
- Lead the technical design and implementation of EGI Foundry, providing the
foundation, runtime, and interfaces for rapidly developing, deploying, and
orchestrating enterprise AI applications.
- Architect graph representations, property graph libraries, and ontology
services (including GoogleSQL graph integration) to model enterprise
processes, document relationships, and system understanding for multi-agent
workflows.
- Partner on next-generation Human-in-the-Loop (HITL) frameworks, designing
feedback loops that automatically convert human corrections into improved
prompts, fine-tuning datasets, and verification benchmarks for hard-to-verify
tasks.
- Build robust, low-latency, and compliant integration points with core Cloud
and Alphabet systems (Salesforce, SAP, Vertex AI, Gemini Enterprise).
- Set technical direction, author high-impact design docs, lead architecture
reviews, and mentor engineers. Collaborate with partners including Cloud AI,
Core Data Insights, and Finance Engineering.
Responsibilities
- Lead the design and implementation of the EGI Foundry platform for developing, deploying, and orchestrating enterprise AI applications.
- Architect graph representations, property graph libraries, and ontology services for enterprise workflows and multi-agent systems.
- Design human-in-the-loop feedback frameworks that improve prompts, training data, and verification benchmarks.
- Build low-latency, compliant integrations with Cloud and Alphabet systems.
- Set technical direction, lead architecture reviews, author design documents, and mentor engineers.
Qualifications
- Bachelor's degree or equivalent practical experience.
- At least 8 years of software development experience.
- At least 5 years of experience testing and launching software products, and 3 years in software design and architecture.
- At least 5 years leading machine learning design and optimizing end-to-end ML systems.
- At least 2 years of experience with generative AI techniques or related concepts.
- Experience with AI platforms, generative AI agents, and large-scale distributed systems.
- Preferred: Master's degree or PhD in a related technical field; experience with data structures and algorithms, technical leadership, complex cross-functional organizations, human-in-the-loop workflows, and Google Cloud Platform.
Benefits
- 20% bonus target
- Equity
- Benefits
Skills mentioned
About Google
A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone. Check out our career opportunities at goo.gle/3DLEokh
H-1B sponsorship history
Historical employer filing data was found for Google. The employer record includes 57,181 historical certified applications. This is employer-level history, not a guarantee that this role currently offers sponsorship.