Staff Software Engineer, Cloud ML Compute Services

Google

Kirkland, Washington, United StatesFull-time$207,000–$300,000Posted Nov 5, 2026

About the role

MINIMUM QUALIFICATIONS:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience programming in C++.
  • 5 years of experience testing, and launching software products.
  • 5 years of experience building and developing large-scale infrastructure,

distributed systems or networks, or experience with compute technologies,

storage, or hardware architecture.

  • 3 years of experience with software design and architecture.

PREFERRED QUALIFICATIONS:

  • Master’s degree or PhD in Engineering, Computer Science, or a related

technical field.

  • 8 years of experience with data structures and algorithms.
  • 3 years of experience in a technical leadership role leading project teams

and setting technical direction.

  • 3 years of experience working in a complex, matrixed organization involving

cross-functional, or cross-business projects.

ABOUT THE JOB:

Google Cloud's software engineers develop the next-generation technologies that

change how billions of users connect, explore, and interact with information and

one another. We're looking for engineers who bring fresh ideas from all areas,

including information retrieval, distributed computing, large-scale system

design, networking and data storage, security, artificial intelligence, natural

language processing, UI design and mobile; the list goes on and is growing every

day. As a software engineer, you will work on a specific project critical to

Google Cloud's needs with opportunities to switch teams and projects as you and

our fast-paced business grow and evolve. You will anticipate our customer needs

and be empowered to act like an owner, take action and innovate. We need our

engineers to be versatile, display leadership qualities and be enthusiastic to

take on new problems across the full-stack as we continue to push technology

forward.

The Cloud ML Compute Services team is building the next generation of on-premise

AI infrastructure to empower AI solution builders globally. We design fully

integrated AI systems—spanning hardware, software, and workload management—to

optimize large-scale training and inference workloads. Our mission is to enable

seamless production operations for our customers while maintaining comprehensive

visibility into the hardware health of Google's global fleet. Join us to build a

brand-new product in a fast-paced environment and help shape the future of AI

acceleration, cluster interconnects, and networking.

Google Cloud accelerates every organization’s ability to digitally transform its

business and industry. We deliver enterprise-grade solutions that leverage

Google’s cutting-edge technology, and tools that help developers build more

sustainably. Customers in more than 200 countries and territories turn to Google

Cloud as their trusted partner to enable growth and solve their most critical

business problems.Individual pay is determined by factors including job-related

skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

Learn more about benefits at Google

[https://www.google.com/about/careers/applications/benefits/].

RESPONSIBILITIES:

  • Set the strategic direction and technical roadmap to build scalable,

next-generation on-premise AI infrastructure and compute services.

  • Guide the design and development of complex cloud and systems-level

infrastructure, spanning the entire hardware and software stack, including

low-level software, OS, firmware, and networking.

  • Act as a technical leader within a newly formed team to mentor and grow

software engineers, successfully scoping bold, ambiguous problems into

tractable projects.

  • Define and implement clear success metrics, integrating service level

objectives (SLOs), telemetry, and logs to ensure seamless production

operations and continuous improvement.

  • Take central ownership of system troubleshooting and diagnostics, leading

specialized efforts to resolve complex technical issues and build automated

repair systems for the global fleet.

Responsibilities

  • Set the strategic direction and technical roadmap for scalable on-premise AI infrastructure and compute services.
  • Guide the design and development of systems-level infrastructure across hardware, software, operating systems, firmware, and networking.
  • Lead and mentor engineers, turning ambiguous problems into scoped projects.
  • Define success metrics and use SLOs, telemetry, and logs to improve production operations.
  • Lead troubleshooting and diagnostics, and develop automated repair systems for Google's global fleet.

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience programming in C++.
  • 5 years of experience testing and launching software products.
  • 5 years of experience building large-scale infrastructure, distributed systems, networks, or compute, storage, or hardware technologies.
  • 3 years of experience in software design and architecture.
  • Preferred: Master's degree or PhD in a related technical field.
  • Preferred: 8 years of experience with data structures and algorithms.
  • Preferred: 3 years in a technical leadership role leading project teams and setting technical direction.

Benefits

  • 20% target bonus
  • Equity
  • Benefits

Skills mentioned

C++Distributed SystemsSystem DesignSoftware TestingPerformance OptimizationGoogle CloudLinuxTCP/IPSystems EngineeringEmbedded Systems

About Google

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone. Check out our career opportunities at goo.gle/3DLEokh

Software Development10,001+ employeesMountain View, CA

H-1B sponsorship history

Historical employer filing data was found for Google. The employer record includes 57,181 historical certified applications. This is employer-level history, not a guarantee that this role currently offers sponsorship.