<section style="margin-bottom: 20px;">
 <h2 style="color: #34495e; font-size: 1.2em; margin: 20px 0 10px 0;">Responsibilities</h2>
 <p style="line-height: 1.6; margin-bottom: 15px;">Designing and implementing highly performant data pipelines from multiple sources using Apache Spark and/or Azure Databricks. Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained. Working with other members of the project team to support delivery of additional project components. Evaluating the performance and applicability of multiple tools against customer requirements. Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints. Direct experience of building data pipelines using Azure Data Factory and Apache Spark. Expert level understanding on Azure Data Factory Azure Synapse Azure SQL Azure Data Lake and Azure App Service is required.</p>
</section>

<section style="margin-bottom: 20px;">
 <h2 style="color: #34495e; font-size: 1.2em; margin: 20px 0 10px 0;">Key Skills</h2>
 <ul style="padding-left: 20px; margin: 10px 0;">
 <li style="margin: 10px 0; line-height: 1.6;">ETL.</li>
 <li style="margin: 10px 0; line-height: 1.6;">Data modeling.</li>
 <li style="margin: 10px 0; line-height: 1.6;">Data warehouse.</li>
 <li style="margin: 10px 0; line-height: 1.6;">Data pipelining.</li>
 <li style="margin: 10px 0; line-height: 1.6;">Data security and compliance.</li>
 <li style="margin: 10px 0; line-height: 1.6;">Database.</li>
 <li style="margin: 10px 0; line-height: 1.6;">Machine learning.</li>
 <li style="margin: 10px 0; line-height: 1.6;">SQL.</li>
 <li style="margin: 10px 0; line-height: 1.6;">Big data.</li>
 </ul>
</section>

Azure Data Engineer

Job Description

Responsibilities

Key Skills

Required Skills