Big Data Engineer

Key Responsibilities

• Develop solutions related to Big Data and Data Sciences from end-to-end.
• Develop and maintain scalable data pipelines that will ingest, transform, and distribute data streams and/or batches within the AWS, Snowflake, and Microsoft Platforms.
• Identify, design, and implement process improvements for automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability.
• Demonstrate self-motivation, self-direction, and strong problem-solving skills.
• Support and decommission legacy platforms.
• Enable business strategy, lean processes, increased data velocity, and insights.
• Embody a culture of continuous innovation and learning.
• Adhere to programming/development standards and governance framework.
• Collaborate with business analytical teams and data scientists to improve efficiency, increase the applicability of predictive models, and help translate ad hoc analyses into scalable data delivery solutions.
• Consult on data ingestion, data modeling, security, and capabilities.
• Manage the innovation cycle of conducting analyses and generating insights.
• Assist with the selection and management of consultants and vendors.
• Assist with the recruitment and development of talent.
• Collaborate with the DevOps team to integrate innovations and algorithms into a production system.
• Support business decisions with ad hoc analysis as needed.
• Work with the DevOps team to create and manage deployment workflows.