Senior Staff Software Development Engineer

Position Overview

WHAT YOU DO AT AMD CHANGES EVERYTHING. At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. AMD is looking for a world class AI frameworks engineer to provide technical leadership in developing and optimizing deep learning frameworks for AMD GPUs. In this role, you will engage with internal GPU library teams and open-source maintainers, utilizing cutting-edge compiler technologies and advanced engineering principles to drive continuous improvement. If you are passionate about AI/ML frameworks, software architecture, and compilers, this opportunity allows you to guide next generation framework software while collaborating with multiple geographically dispersed engineering teams.

Key Responsibilities

• Optimize Deep Learning Frameworks: Enhance and optimize frameworks like PyTorch, vLLM, and SGLang for AMD GPUs in open-source repositories.
• Develop GPU Kernels: Create and optimize GPU kernels to maximize performance for specific AI operations.
• Develop & Optimize Models: Design and optimize deep learning models using quantization specifically for AMD GPU performance.
• Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improve training and inference performance on AMD GPUs.
• Collaborate with Open-Source Maintainers: Engage with framework maintainers to ensure code changes are aligned with requirements and integrated upstream.
• Software Engineering Best Practices: Apply sound engineering principles to ensure robust, maintainable solutions.

Required Qualifications

• Education: BS, MS or PhD in Computer Science, Computer Engineering, Electrical Engineering, or related technical fields.
• Experience Required: Proven experience in AI frameworks, deep learning, and technical leadership to develop and optimize software solutions.

Preferred Qualifications

• GPU Kernel Development & Optimization: Experienced in designing and optimizing GPU kernels for deep learning on AMD GPUs using HIP, CUDA, and assembly (ASM), with strong knowledge of AMD architectures (GCN, RDNA).
• Experience with AI software frameworks such as PyTorch, vLLM, and SGLang, including benchmarking and profiling.
• Familiarity with profiling and benchmark tooling for large models.
• Experience with model optimization techniques, including low-precision quantization (MXFP4, FP8, INT4) and sparsity.
• Solid understanding of model architectures, LLMs, MoE, and diffusion.
• Proficient in C++ programming and experienced in developing and debugging in Python.
• Strong team player with experience working with geographically distributed teams.

Benefits & Perks

• Benefits: AMD benefits at a glance.