Data Engineer (ETL / PySpark / Delta Lake) / Automotive Domain-5

Realign LLC10 months ago
Detroit, MI, United States
On-site
Contract
Junior Level (1-3 years)

Job Description

Position Overview

We are seeking a Data Engineer (ETL / PySpark / Delta Lake) – Automotive Domain for a Contract position located in Detroit, MI 48092. This role is on-site for a duration of 6 Months and requires a candidate with 5–10 Years of experience, ideally working within the IT industry.

Key Responsibilities

  • Perform data engineering and analysis using Databricks across multiple source systems.
  • Create, manage, and orchestrate batch jobs and pipelines.
  • Design and develop reports and dashboards based on batch job outputs.
  • Build and maintain reusable components, libraries, and design systems.
  • Ensure code quality, conduct peer reviews, and enforce best practices.
  • Collaborate with multidisciplinary teams including R&D and Manufacturing.
  • Demonstrate strong problem-solving, analytical thinking, and adaptability.
  • Work effectively cross-functionally and cross-culturally.

Required Qualifications

  • Strong Data Engineering experience using ETL, PySpark, Delta Lake, and SQL for ingestion.
  • Experience with PID/DID slicing and MERS parsing.
  • Proficiency in batch job orchestration (Databricks job triggers, parameter passing).
  • Experience in developing visualizations and reports (Power BI, Databricks dashboards).
  • Educational Background: MS/MTech/BTech in Computer Science, Electrical, Mechanical, or related engineering fields.

Preferred Qualifications

  • Experience in the Manufacturing/Automotive industry, particularly with warranty systems.
  • Hands-on experience with Agile methodologies.
  • USP of the Role: Opportunity to work directly with R&D and Manufacturing teams on real automotive OEM challenges, with exposure to cutting-edge initiatives in a company committed to an all-electric future.

Required Skills

ETL
Databricks job triggers
Delta Lake
MERS parsing
SQL
Databricks dashboards
Power BI
PySpark
PID/DID slicing
Batch job orchestration
Agile methodology
Automotive domain