Senior Data Engineer (Python, Scala, or Spark)

Position Overview

Are you a highly skilled and experienced Data Engineer looking for a new challenge? Join our team at Capital One as a Senior Data Engineer and leverage cutting‐edge technologies to drive business insights. In this role, you will design and implement data solutions using Python, Scala, or Spark to support our growing data needs. If you are ready to take your career to the next level and make a significant impact in the world of data, we would love to hear from you! Capital One is an Equal Opportunity Employer committed to creating an inclusive environment for all.

Key Responsibilities

• Design and implement complex data solutions using Python, Scala, or Spark
• Collaborate with cross-functional teams to understand business needs and translate them into technical requirements
• Develop efficient and scalable data pipelines to process and analyze large volumes of data
• Identify and resolve data quality issues and performance bottlenecks
• Stay updated on emerging technologies and industry trends to continuously improve data processes and systems
• Conduct thorough testing and validation to ensure accuracy and completeness of data
• Troubleshoot and debug data issues in a timely manner
• Create and maintain technical documentation for data solutions
• Mentor and provide guidance to junior data engineers on best practices and coding standards
• Work closely with data scientists and analysts to support their data needs and enable them to derive meaningful insights
• Proactively identify opportunities for process improvement and optimization in data management processes
• Adhere to company data security and privacy policies and ensure compliance with regulatory requirements