Lead Data Engineer (Python, AWS, SQL)

Capital One12 months ago
Baltimore, Maryland, United States
Hybrid
Full-time
Junior Level (1-3 years)

Job Description

Position Overview

Capital One is seeking a Lead Data Engineer (Python, AWS, SQL) who is passionate about marrying data with emerging technologies.
You’ll be on the forefront of a major transformation, working in a fast-paced, collaborative, and innovative environment to solve complex business challenges.

Key Responsibilities

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development.
  • Work with a team of developers experienced in machine learning, distributed microservices, and full stack systems.
  • Utilize programming languages such as Java, Scala, Python along with RDBMS, NoSQL databases, and cloud-based data warehousing (Redshift and Snowflake).
  • Stay current with tech trends, experiment with new technologies, and mentor other engineering team members.
  • Collaborate with digital product managers to deliver robust cloud-based solutions that drive powerful customer experiences.
  • Perform unit testing and conduct code reviews to ensure quality, performance, and maintainability.

Required Qualifications

  • Bachelor’s Degree
  • At least 4 years of experience in application development (internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud)

Preferred Qualifications

  • 7+ years of experience in application development including Python, SQL, Scala, or Java
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, or Google Cloud)
  • 4+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, etc.)
  • 4+ years of experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementations (MongoDB, Cassandra)
  • 4+ years of data warehousing experience (Redshift or Snowflake)
  • 4+ years of experience with UNIX/Linux, including basic commands and shell scripting
  • 2+ years of experience with Agile engineering practices

Benefits & Perks

  • Compensation: Competitive salary ranges offered – McLean, VA: $193,400 - $220,700; Richmond, VA: $175,800 - $200,700, along with performance-based incentive compensation (cash bonuses and/or long term incentives).
  • Benefits: Comprehensive, competitive, and inclusive health, financial, and other benefits that support your total well-being.

Required Skills

Scala
Big Data
Agile
Redshift
Linux
Snowflake
Kafka
Java
Python
Distributed Microservices
SQL
AWS
Spark
Hadoop