Lead AI Software Engineer
HP IQ8 months ago
San Francisco, CA, United States
Remote
Full-time
Junior Level (1-3 years)
Job Description
About The Role
The AI team is building cutting-edge solutions that bring the power of AI directly to edge devices while seamlessly integrating with cloud infrastructure. We are looking for a Lead Software Engineer to design and develop high-performance, scalable services to support AI workloads across edge and cloud environments.
What You Might Do
- Design, build, and maintain services that power AI-driven applications, ensuring scalability and performance.
- Develop APIs and microservices that facilitate seamless integration between cloud-based AI models and edge devices.
- Optimize data pipelines and storage solutions for real-time AI inference and processing.
- Implement security and privacy best practices for distributed AI systems.
- Work closely with AI researchers, infrastructure engineers, and frontend developers to deliver end-to-end AI-driven solutions.
- Build and optimize an agent orchestration runtime that enables tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems.
- Develop robust logging, monitoring, and alerting systems to ensure system reliability.
Essential Qualifications
- 10+ years of experience in backend software development, with strong proficiency in Java, C++, or Python.
- Proficient in LLM integration into multi-agent systems with strong understanding of agent orchestration, tool use, and memory/context management.
- Comfortable tinkering with LLMs via prompting and experienced with tools use, task decomposition, and structured outputs.
- Experience building distributed systems, microservices, and cloud-native applications.
- Strong knowledge with building secure, privacy-aware interfaces between models, devices, and external services.
- Familiarity with database management systems (SQL and NoSQL) and data streaming technologies.
- Strong problem-solving skills and ability to work in a fast-paced, agile environment.
Preferred Skills
- Experience with AI model deployment and integration into backend services.
- Knowledge of edge computing, networking, and security best practices.
- Exposure to cloud-edge hybrid architectures and distributed AI workloads.
- Familiarity with on-device AI frameworks such as TensorFlow Lite, ONNX Runtime, or CoreML.
Salary range: $190,000 - $270,000
Required Skills
Database management (SQL, NoSQL)
Edge computing
Python
Data streaming technologies
C++
TensorFlow Lite
Security best practices
Networking
CoreML
Agent orchestration
LLM integration
Java
Distributed systems
Microservices
ONNX Runtime
Cloud-native applications
AI model deployment