Helix AI Engineer (Agentic Systems)
Figure5 months ago
San Jose, CA, United States
Hybrid
Full-time
Junior Level (1-3 years)
Job Description
Job Description
We are looking for a Helix AI Engineer, Agentic Systems experienced in building multimodal reasoning systems—agents that operate autonomously from raw sensory input, maintain episodic memory, plan over long horizons, and execute reliably within structured evaluation harnesses, e.g. pixels-to-actions computer use agents.
This role focuses on developing the agent architectures and infrastructure that enable robots to function as persistent, reliable embodied agents in the real world.
Your Responsibilities
- Design, train, and deploy multimodal agents that operate autonomously for hours to days.
- Build agents that reason from raw sensory inputs (pixels, environment state, proprioception) to structured actions.
- Implement episodic memory systems for persistent state, retrieval, and long-horizon reasoning.
- Develop planning, reasoning, and tool-use mechanisms for multi-step task execution.
- Build reliable perception → reasoning → action loops with strong stability and failure recovery.
- Design evaluation harnesses, benchmarks, and metrics to measure agent reasoning, planning, and reliability.
- Design and run data studies across the training lifecycle, including pretraining, mid-training, and post-training.
- Apply reinforcement learning, reward modeling, and post-training techniques to improve agent reasoning and reliability in real-world environments.
- Develop evaluation frameworks and benchmarks to measure robot reasoning, planning, and task success across diverse scenarios.
- Build infrastructure for scalable model training, distributed experimentation, and agent evaluation.
- Work closely with other teams to integrate agent models into the full humanoid autonomy stack.
Required Skills
Long-horizon planning
Autonomous agents
Integration of agent models
Reward modeling
Episodic memory systems
Robotics
Reinforcement learning
Distributed experimentation
Evaluation frameworks
Multimodal reasoning systems
Data studies
Scalable model training