Lead Engineer, Big Data (AI/Azure Data Services) - REMOTE
Molina Healthcare5 months ago
Tampa, FL, United States
Remote
Full-time
Junior Level (1-3 years)
Job Description
Position Overview
A Lead Data Engineer collaborates with the Data Quality and Governance team to ensure data pipelines, data integrity, and compliance by defining data strategies, implementing Data Governance capabilities, creating self-service data assets, and integrating robust data quality and governance frameworks to support trustworthy AI solutions. This role involves designing scalable data architectures, establishing data quality standards and monitoring, managing data lineage, and ensuring adherence to regulatory requirements and privacy policies.
Key Responsibilities
- Data Quality & Governance Leadership: Define and enforce data quality standards, validation rules, and monitoring systems tailored to healthcare data; collaborate with data stewards, compliance officers, and business stakeholders; and develop metadata management tools.
- Regulatory Compliance & Security: Ensure all data engineering practices align with healthcare regulations such as HIPAA and HITECH, and implement data governance policies for secure and ethical data usage.
- Data Architecture & Lifecycle Management: Design scalable data architectures supporting healthcare analytics and AI/ML workflows; automate data lineage tracking and establish lifecycle policies for retention, archiving, and disposal.
- AI/ML Enablement: Collaborate with data scientists and ML engineers to build end-to-end AI pipelines and support the development of trustworthy AI with well-governed data.
- Cross-Functional Collaboration: Partner with clinical informatics, compliance, IT, and analytics teams to align data engineering initiatives with healthcare delivery and governance strategies.
- Lead by Example: Utilize hands-on experience with Data Quality and Governance tools, including Databricks, Power BI, and Azure Data Services; lead technical issue resolution with infrastructure and vendor support teams.
- Leadership & Mentorship: Lead and mentor a team of data engineers while overseeing project delivery and ensuring alignment with enterprise data governance objectives.
- Job Function: Responsible for the architecture, design, and implementation of Data Governance within Databricks.
Required Qualifications
- Bachelor's Degree
- 8+ years of data management experience, including prior leadership of projects or teams
- Proven experience with Data Lake, Data Warehouse, Data Validation & Certification, Data Quality, Metadata Management, and Data Governance
- Expertise in Azure Data Services (such as Azure Databricks, Unity Catalog, Purview, Azure Data Factory), Power BI, and programming languages (e.g., PySpark, Python, SQL)
- Experience with building stream-processing systems (e.g., Kafka, Storm, or Spark-Streaming) and implementing AI-based solutions in the Data Governance space
Preferred Qualifications
- Master's Degree
- Experience in the healthcare industry
Benefits & Perks
- Benefits & Compensation: Molina Healthcare offers a competitive benefits and compensation package.
Required Skills
Data Quality
Metadata Management
Team Mentorship
Leadership
Data Governance
Azure Data Services
Stream Processing
PySpark
Power BI
SQL
Regulatory Compliance
Data Architecture
Data Engineering
Python
Databricks