Senior Lead AI Engineer (Gen AI Platform Services)

Position Overview

Senior Lead AI Engineer (Gen AI Platform Services) at Capital One. At Capital One, we are creating responsible and reliable AI systems that change banking for good. Our deep investments in technology, infrastructure, and world‐class talent have positioned us at the forefront of machine learning innovations—from real‐time personalized customer experiences to scalable, high-performance AI applications. Joining the Intelligent Foundations and Experiences (IFX) team, you will help bring the transformative power of emerging AI capabilities to reimagine the way we serve our customers while building breakthrough product experiences.

Key Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and introduce state-of-the-art LLM optimization techniques to improve the performance—scalability, cost, latency, throughput—of large-scale production AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Required Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI/ML algorithms or technologies; or a Master's degree with at least 4 years of relevant experience.
• At least 6 years of experience programming with Python, Go, Scala, or Java.

Preferred Qualifications

• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders.
• Experience developing AI/ML algorithms or technologies (e.g. LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, or Golang.
• Experience applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
• Passion for staying abreast of the latest AI research and judiciously applying novel techniques in production.
• Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers.

Benefits & Perks

• Compensation: Salary ranges vary by location. For example, in Cambridge, MA and McLean, VA the range is $225,400 - $257,200, while in New York, NY, San Francisco, CA, and San Jose, CA the range is $245,900 - $280,600.
• Performance Incentives: This role is eligible to earn performance-based incentive compensation, which may include cash bonuses and/or long-term incentives.
• Benefits: Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits to support your total well-being. Visit the Capital One Careers website for more details.