Data Engineer (ETL / PySpark / Delta Lake) / Automotive Domain-5

Realign LLC9 months ago
Detroit, MI, United States
On-site
Contract
Junior Level (1-3 years)

Job Description

Position Overview

Role: Data Engineer (ETL / PySpark / Delta Lake) – Automotive Domain
Location: Detroit, MI 48092 (100% Onsite)
Experience Required: 5–10 Years
Schedule: Contract (6 Months)
Education: MS/MTech/BTech in CS, EE, Mechanical, or related engineering fields.

This role offers the unique opportunity to work directly with R&D and Manufacturing teams on real automotive OEM challenges, while gaining exposure to cutting-edge initiatives in a company committed to an all-electric future.

Key Responsibilities

  • Perform data engineering and analysis using Databricks across multiple source systems.
  • Create, manage, and orchestrate batch jobs and pipelines.
  • Design and develop reports and dashboards based on batch job outputs.
  • Build and maintain reusable components, libraries, and design systems.
  • Ensure code quality, conduct peer reviews, and enforce best practices.
  • Collaborate with multidisciplinary teams including R&D and Manufacturing.
  • Demonstrate strong problem-solving, analytical thinking, and adaptability.
  • Work effectively in cross-functional and cross-cultural settings.

Required Qualifications

  • Strong Data Engineering experience using ETL, PySpark, Delta Lake, and SQL for data ingestion.
  • Experience with PID/DID slicing and MERS parsing.
  • Proven expertise in batch job orchestration (Databricks job triggers, parameter passing).
  • Experience in visualization and reporting development (Power BI, Databricks dashboards).

Preferred Qualifications

  • Manufacturing or Automotive industry experience, particularly with warranty systems.
  • Experience working in an Agile environment.

Required Skills

Delta Lake
Parameter Passing
Databricks Job Triggers
PySpark
ETL
SQL
Visualization & Reporting
Power BI
Automotive Domain Knowledge
Agile Methodology
Batch Job Orchestration