Sr Software Engineer - AI

The Trade Desk3 months ago
San Jose, CA, United States
Remote
Full-time
Junior Level (1-3 years)

Job Description

Position Overview

The Trade Desk is a global technology company on a mission to create a better, more open internet. As a Sr AI Software Engineer, you will be an end-to-end owner charged with building internal-facing AI solutions that leverage large language models and advanced tools to enhance productivity and drive innovation across the organization.

Key Responsibilities

  • Design and deploy intelligent agentic systems that integrate large language models with enterprise data, tools, and workflows using frameworks like LangChain, LlamaIndex, and Semantic Kernel.
  • Develop Retrieval-Augmented Generation (RAG) applications using tools such as Azure AI Search, vector databases, and secure enterprise connectors to deliver contextual insights.
  • Build and iterate on conversational agents that solve real-world problems and deliver measurable business value.
  • Collaborate across teams to deliver high-impact features, lead through ambiguity, and align technical solutions with business goals.
  • Drive quality and performance through automated testing, monitoring, and data-driven evaluations.
  • Mentor teammates and help foster a culture of innovation, technical excellence, and continuous learning.

Required Qualifications

  • Bachelor’s/Master’s degree in computer science or a related field, or equivalent experience.
  • 8-10+ years of software engineering experience, including 1-2+ years working on AI-powered systems or products.
  • Proficiency in Python and comfort with additional languages such as C#, SQL, or TypeScript/React.
  • Hands-on experience with LLM orchestration frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel) and prompt engineering using LLM APIs.
  • Experience productionizing applications and implementing CI/CD pipelines.
  • Skilled in data ingestion and transformation using APIs, ETL pipelines, and connectors, along with familiarity with vector databases and retrieval strategies.
  • Excellent communication skills, with the ability to work effectively across technical and non-technical audiences.
  • A fast learner with a proven ability to adapt to new technologies and solve complex problems creatively.

Benefits & Perks

  • Compensation: Base salary range of $124,900—$228,900 USD, determined based on experience, skills, and location.
  • Comprehensive healthcare including medical, dental, and vision with premiums paid in full for employees and their dependents.
  • Retirement benefits such as a 401k plan with company match.
  • Disability coverage, basic life insurance, well-being benefits, and tuition reimbursement.
  • Generous parental leave, sick time (1 hour per 30 hours worked), vacation accrual, and approximately 13 paid holidays per year.
  • Opportunity to purchase The Trade Desk stock at a discount through the Employee Stock Purchase Plan.

Required Skills

SQL
TypeScript
Prompt Engineering
C#
LlamaIndex
Data Ingestion
Vector Databases
Python
Semantic Kernel
CI/CD
RAG Applications
Agentic Systems
LLM orchestration
React
LangChain
ETL