Senior Data Engineer, ML Infrastructure
Serve Robotics10 months ago
Los Angeles, CA, United States
Hybrid
Full-time
Junior Level (1-3 years)
Job Description
Position Overview
At Serve Robotics, we’re reimagining city mobility with our personable sidewalk robot designed to simplify deliveries and benefit local businesses. As a Senior Data Engineer on our Machine Learning Infrastructure team, you will build a petabyte-scale data platform supporting ML and autonomy innovations, directly driving new revenue through the commercialization of robot data.
Key Responsibilities
- Architect and implement robust, scalable data pipelines to process, synchronize, and package robotics data (e.g., LiDAR, camera, IMU, proprietary maps) for third-party consumption.
- Build a data processing and egress platform, ensuring the timely and accurate delivery of datasets according to strict partner SLAs.
- Create data lifecycle policies to control cloud data costs, maintain a universal data catalogue of raw robot data, and develop cost monitoring, attribution, and alerting systems.
- Develop data discoverability features using ML models to generate new attributes and maintain efficient, highly scalable search indexes.
- Set up data access audit trails with strong security controls managed through Infrastructure as Code (IaC) and expose data lineage to internal consumers.
Required Qualifications
- 5+ years of professional experience in software or data engineering.
- Strong programming proficiency in Python and SQL.
- Hands-on experience building and maintaining large-scale data processing pipelines using cloud technologies.
- Proficiency with data warehousing and ETL/ELT concepts.
- Solid understanding of system design, data privacy, and security best practices.
Preferred Qualifications
- Experience setting up IaC to orchestrate cloud resources and security policies.
- Familiarity with GCP and fully managed cloud infrastructure.
- Knowledge of robotics data such as LiDAR, multi-modal camera, and mapping.
- Experience in a fast-paced startup environment.
- Expertise in building and optimizing terabyte-scale data pipelines.
Benefits & Perks
- Compensation Range: $185K - $235K
Required Skills
System Design
Data Pipeline Architecture
Data Security
Python
Data Warehousing
Robotics Data Processing
Infrastructure as Code (IaC)
SQL
GCP
Cloud Technologies
ETL/ELT