Lead ML Inference Engineer (Advertising)

Job Description

• The Advertising Performance group focuses on performance for all participants in the Advertising ecosystem - Advertisers, Publishers, and Roku

• The systems and solutions span multiple disciplines and technologies to perform real-time multi-objective optimization across distributed systems at large scale and with low latency. We use Machine Learning, Reinforcement Learning, AI, Control and Optimization Systems, and Auction Dynamics to solve a large set of complex problems

• At the core of this is our Machine Learning and Inference Platform that powers the entire landscape

• In this role, you will architect, design, and lead the development of a SOTA Inference platform that can handle Advertising-level low latencies, scale, throughput, and availability with optimizations that span across hardware, software, and model

• Lead the design and development of a SOTA Inference platform

• Oversee the development of monitoring, observability, and other tooling to ensure system and model performance, reliability, and scalability of online inference services

• Identify and resolve system inefficiencies, performance bottlenecks, and reliability issues, ensuring optimized end-to-end performance

• Stay at the forefront of advancements in inference frameworks, ML hardware acceleration, and distributed systems, and incorporate innovations where and when they are impactful

Benefits

• Medical, wellness and financial benefits
• Free snacks and access to the company fitness center
• Unlimited paid time off policy
• Work from home opportunities