Data Engineer (ETL / PySpark / Delta Lake) / Automotive Domain-5
Realign LLC9 months ago
Detroit, MI, United States
On-site
Contract
Junior Level (1-3 years)
Job Description
Position Overview
Role: Data Engineer (ETL / PySpark / Delta Lake) – Automotive Domain
Location: Detroit, MI 48092 (100% Onsite)
Experience Required: 5–10 Years
Schedule: Contract (6 Months)
Education: MS/MTech/BTech in CS, EE, Mechanical, or related engineering fields.
This role offers the unique opportunity to work directly with R&D and Manufacturing teams on real automotive OEM challenges, while gaining exposure to cutting-edge initiatives in a company committed to an all-electric future.
Key Responsibilities
- Perform data engineering and analysis using Databricks across multiple source systems.
- Create, manage, and orchestrate batch jobs and pipelines.
- Design and develop reports and dashboards based on batch job outputs.
- Build and maintain reusable components, libraries, and design systems.
- Ensure code quality, conduct peer reviews, and enforce best practices.
- Collaborate with multidisciplinary teams including R&D and Manufacturing.
- Demonstrate strong problem-solving, analytical thinking, and adaptability.
- Work effectively in cross-functional and cross-cultural settings.
Required Qualifications
- Strong Data Engineering experience using ETL, PySpark, Delta Lake, and SQL for data ingestion.
- Experience with PID/DID slicing and MERS parsing.
- Proven expertise in batch job orchestration (Databricks job triggers, parameter passing).
- Experience in visualization and reporting development (Power BI, Databricks dashboards).
Preferred Qualifications
- Manufacturing or Automotive industry experience, particularly with warranty systems.
- Experience working in an Agile environment.
Required Skills
Delta Lake
Parameter Passing
Databricks Job Triggers
PySpark
ETL
SQL
Visualization & Reporting
Power BI
Automotive Domain Knowledge
Agile Methodology
Batch Job Orchestration