Databricks Data Engineer - Senior - Consulting - Location Open 1

Position Overview

Location: Anywhere in Country. At EY, we’re all in to shape your future with confidence. We help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY to build a better working world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate possesses strong client management and communication skills with a proven track record of successful end-to-end implementations in data engineering projects.

Key Responsibilities

• Designing, building, and operating scalable on-premises or cloud data architecture.
• Analyzing business requirements and translating them into technical specifications.
• Optimizing data flows for target data platform designs.
• Designing, developing, and implementing data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP).
• Collaborating with clients to understand their data needs and provide tailored solutions that meet business objectives.
• Leading end-to-end data pipeline development including data ingestion, transformation, and storage.
• Ensuring data quality, integrity, and security throughout the data lifecycle.
• Providing technical guidance and mentorship to junior data engineers and team members.
• Communicating complex data concepts effectively with technical and non-technical stakeholders.
• Managing client relationships and expectations to ensure high levels of satisfaction and engagement.
• Staying updated with the latest trends and technologies in data engineering and cloud computing.

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field (4-year degree required); Master’s degree preferred.
• 2–4 years of relevant experience in data engineering with a focus on cloud data solutions, and 5+ years overall experience in the field.
• Expertise in Databricks and experience with Spark for big data processing.
• Proven experience in at least two end-to-end data engineering implementations, including:
  • Implementation of a data lake solution using Databricks by integrating various data sources for analytics.
  • Development of a real-time data processing pipeline using Databricks and cloud services for operational decision-making.
• Strong programming skills in Python, Scala, or SQL.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Excellent problem-solving skills and the ability to work both independently and collaboratively.
• Strong communication and interpersonal skills with a focus on client management.
• Strategic Thinking: Ability to align data engineering solutions with overall business strategies and objectives.
• Project Management: Experience managing multiple projects simultaneously with timely delivery and adherence to scope.
• Stakeholder Engagement: Proficiency in engaging with various stakeholders, including executives, to understand their needs and present effective solutions.
• Change Management: Skills in guiding clients through data transformation and technology adoption processes.
• Risk Management: Ability to identify potential risks in data projects and develop effective mitigation strategies.
• Technical Leadership: Proven experience in leading technical discussions and making key architectural decisions.
• Documentation and Reporting: Capable of creating comprehensive documentation and reports to communicate project progress and outcomes.

Preferred Qualifications

• Experience with data quality management.
• Familiarity with semantic layers in data architecture.
• Experience with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data governance and compliance standards.
• Experience with machine learning frameworks and tools.

Benefits & Perks

• We offer a comprehensive compensation and benefits package. Base salary range in the US: $106,900 to $176,500; for NYC Metro, Washington State, and California (excluding Sacramento): $128,400 to $200,600.
• Team-led and leader-enabled hybrid work model with an expectation of in-person collaboration 40–60% of the time.
• Flexible vacation policy with time off based on individual needs, plus EY Paid Holidays, Winter/Summer breaks, and Personal/Family Care leave options.