Sr Data Engineer
Job Description
Responsibilities
Building data architectures and data pipelines to collectively bring together data. Designing solutions using Microsoft Azure services and other tools. Assuring that data is cleansed mapped transformed and optimized for storage and use according to business and technical requirements Automating tasks and deploying production standard code. Loading transformed data into storage and reporting structures such as data warehouses real-time reporting systems and analytics applications.
Requirement
Experience in data engineering and cloud data processing services. Hands on Experience in Data Warehousing & ETL tools. Experience building and optimizing 'big data' data pipelines architectures and data sets. Knowledge of SQL and Python/PySpark. Open mindset ability to quickly adapt to new technologies and learn new practices.
Key Skills
- Knowledge of data warehousing and ETL processes.
- Programming languages: Java, Python, R, Scala.
- Big data cloud computing and leadership skills.