Software Engineer, GPU Performance

Kirkland, WA

Full-time

Onsite

$141K/yr - $202K/yr

Entry, Mid Level

Google is a leading technology company that develops next-generation technologies impacting billions of users. They are seeking a Software Engineer to optimize GPU performance for critical products and services, addressing performance bottlenecks and influencing the GPU software ecosystem.

Apply Now

Responsibilities

Build optimizations for the latest generation of GPUs that power Google’s most critical products and services, impacting billions of users worldwide
Address the most challenging performance bottlenecks through Google’s unparalleled access to the latest generation of GPUs, tooling, and a decade of experience building AI accelerators
Drive optimizations across Google’s GPU software stack from ML compiler cost model design to optimizing high performance GPU kernels to cross node model serving configurations
Influence the technical direction of the GPU software ecosystem at Google by collaborating with ML, compiler design, and systems architecture
Influence the deployment of Google’s GPU fleet by working with various product teams across Google

Qualification

Required

Bachelor's degree or equivalent practical experience
2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree
Experience low-level GPU programming (CUDA, Triton, CUTLASS, etc.) and performance engineering techniques
Experience with modern GPU architectures (NVIDIA, AMD, or other AI accelerators), memory hierarchies, and performance bottlenecks

Preferred

Master's degree or PhD in Computer Science or related technical field
2 years of experience with data structures and algorithms in either an academic or industry setting
Experience with compiler optimization, code generation, and runtime systems for GPU architectures (OpenXLA, MLIR, Triton, etc.)
Understanding of modern Large Language Models (LLMs) and their deployment on AI accelerators

Benefits

Health, dental, vision, life, disability insurance
Retirement Benefits: 401(k) with company match
Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
Sick Time: 40 hours/year (statutory, where applicable); 5 days/event (discretionary)
Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
Baby Bonding Leave: 18 weeks
Holidays: 13 paid days per year

Google specializes in internet-related services and products, including search, advertising, and software. It is a sub-organization of Alphabet.

Glassdoor