Senior Lead Data Engineer
Capital One10 months ago
Baltimore, MD, United States
On-site
Full-time
Junior Level (1-3 years)
Job Description
Position Overview
Do you love building and pioneering in the technology space? At Capital One, as a Senior Lead Data Engineer, you will be on the forefront of a major transformation—solving complex business problems in a fast-paced, collaborative environment. You’ll work with a team of makers, breakers, doers, and disruptors, using emerging technologies to drive innovative data solutions.
Key Responsibilities
- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.
- Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems.
- Utilize programming languages like Java, Scala, Python along with Open Source RDBMS, NoSQL databases, and cloud-based data warehousing services such as Redshift and Snowflake.
- Stay on top of tech trends, experiment with new technologies, participate in technology communities, and mentor fellow engineering professionals.
- Collaborate with digital product managers to deliver robust cloud-based solutions that empower millions of Americans.
- Perform unit tests and conduct peer reviews to ensure code is rigorously designed, elegantly coded, and optimized for performance.
Required Qualifications
- Bachelor’s Degree
- At least 6 years of experience in application development (internship experience does not apply)
- At least 2 years of experience in big data technologies
- At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Preferred Qualifications
- Master's Degree
- 9+ years of experience in application development including Python, SQL, Scala, or Java
- 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- 5+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
- 4+ years of experience working on real-time data and streaming applications
- 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
- 4+ years of data warehousing experience (Redshift or Snowflake)
- 4+ years of experience with UNIX/Linux including basic commands and shell scripting
- 2+ years of experience with Agile engineering practices
Benefits & Perks
- Compensation: McLean, VA: $229,900 - $262,400; Richmond, VA: $209,000 - $238,500
- Performance Based Incentives: Eligible for cash bonus(es) and/or long term incentives.
- Comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting your total well-being.
Required Skills
Microsoft Windows Azure
MySQL
Apache Spark
Data Warehousing
Amazon Web Services (AWS)
Python
Apache Hive
Big Data
Cloud Computing
Software Development
Mentoring
Apache Hadoop
Snowflake
Machine Learning
Agile Programming Methodologies
Shell Scripting
Linux Operating System
Team Leadership
Apache Kafka
NoSQL
MapReduce
Unix Operating Systems
Performance Tuning/Optimization
Unit Testing
SQL
Microservices
Apache Cassandra
Problem Solving
Java
Scala
Open Source
Distributed Computing