Sr Software Engineer - AI
The Trade Desk3 months ago
San Jose, CA, United States
Remote
Full-time
Junior Level (1-3 years)
Job Description
Position Overview
The Trade Desk is a global technology company on a mission to create a better, more open internet. As a Sr AI Software Engineer, you will be an end-to-end owner charged with building internal-facing AI solutions that leverage large language models and advanced tools to enhance productivity and drive innovation across the organization.
Key Responsibilities
- Design and deploy intelligent agentic systems that integrate large language models with enterprise data, tools, and workflows using frameworks like LangChain, LlamaIndex, and Semantic Kernel.
- Develop Retrieval-Augmented Generation (RAG) applications using tools such as Azure AI Search, vector databases, and secure enterprise connectors to deliver contextual insights.
- Build and iterate on conversational agents that solve real-world problems and deliver measurable business value.
- Collaborate across teams to deliver high-impact features, lead through ambiguity, and align technical solutions with business goals.
- Drive quality and performance through automated testing, monitoring, and data-driven evaluations.
- Mentor teammates and help foster a culture of innovation, technical excellence, and continuous learning.
Required Qualifications
- Bachelor’s/Master’s degree in computer science or a related field, or equivalent experience.
- 8-10+ years of software engineering experience, including 1-2+ years working on AI-powered systems or products.
- Proficiency in Python and comfort with additional languages such as C#, SQL, or TypeScript/React.
- Hands-on experience with LLM orchestration frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel) and prompt engineering using LLM APIs.
- Experience productionizing applications and implementing CI/CD pipelines.
- Skilled in data ingestion and transformation using APIs, ETL pipelines, and connectors, along with familiarity with vector databases and retrieval strategies.
- Excellent communication skills, with the ability to work effectively across technical and non-technical audiences.
- A fast learner with a proven ability to adapt to new technologies and solve complex problems creatively.
Benefits & Perks
- Compensation: Base salary range of $124,900—$228,900 USD, determined based on experience, skills, and location.
- Comprehensive healthcare including medical, dental, and vision with premiums paid in full for employees and their dependents.
- Retirement benefits such as a 401k plan with company match.
- Disability coverage, basic life insurance, well-being benefits, and tuition reimbursement.
- Generous parental leave, sick time (1 hour per 30 hours worked), vacation accrual, and approximately 13 paid holidays per year.
- Opportunity to purchase The Trade Desk stock at a discount through the Employee Stock Purchase Plan.
Required Skills
SQL
TypeScript
Prompt Engineering
C#
LlamaIndex
Data Ingestion
Vector Databases
Python
Semantic Kernel
CI/CD
RAG Applications
Agentic Systems
LLM orchestration
React
LangChain
ETL