Data Engineer (ETL / PySpark / Delta Lake) / Automotive Domain-5
Realign LLC10 months ago
Detroit, MI, United States
On-site
Contract
Junior Level (1-3 years)
Job Description
Position Overview
We are seeking a Data Engineer (ETL / PySpark / Delta Lake) – Automotive Domain for a Contract position located in Detroit, MI 48092. This role is on-site for a duration of 6 Months and requires a candidate with 5–10 Years of experience, ideally working within the IT industry.
Key Responsibilities
- Perform data engineering and analysis using Databricks across multiple source systems.
- Create, manage, and orchestrate batch jobs and pipelines.
- Design and develop reports and dashboards based on batch job outputs.
- Build and maintain reusable components, libraries, and design systems.
- Ensure code quality, conduct peer reviews, and enforce best practices.
- Collaborate with multidisciplinary teams including R&D and Manufacturing.
- Demonstrate strong problem-solving, analytical thinking, and adaptability.
- Work effectively cross-functionally and cross-culturally.
Required Qualifications
- Strong Data Engineering experience using ETL, PySpark, Delta Lake, and SQL for ingestion.
- Experience with PID/DID slicing and MERS parsing.
- Proficiency in batch job orchestration (Databricks job triggers, parameter passing).
- Experience in developing visualizations and reports (Power BI, Databricks dashboards).
- Educational Background: MS/MTech/BTech in Computer Science, Electrical, Mechanical, or related engineering fields.
Preferred Qualifications
- Experience in the Manufacturing/Automotive industry, particularly with warranty systems.
- Hands-on experience with Agile methodologies.
- USP of the Role: Opportunity to work directly with R&D and Manufacturing teams on real automotive OEM challenges, with exposure to cutting-edge initiatives in a company committed to an all-electric future.
Required Skills
ETL
Databricks job triggers
Delta Lake
MERS parsing
SQL
Databricks dashboards
Power BI
PySpark
PID/DID slicing
Batch job orchestration
Agile methodology
Automotive domain