Lead Data Engineer (Python, AWS, SQL)
Capital One12 months ago
Baltimore, Maryland, United States
Hybrid
Full-time
Junior Level (1-3 years)
Job Description
Position Overview
Capital One is seeking a Lead Data Engineer (Python, AWS, SQL) who is passionate about marrying data with emerging technologies.
You’ll be on the forefront of a major transformation, working in a fast-paced, collaborative, and innovative environment to solve complex business challenges.
Key Responsibilities
- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development.
- Work with a team of developers experienced in machine learning, distributed microservices, and full stack systems.
- Utilize programming languages such as Java, Scala, Python along with RDBMS, NoSQL databases, and cloud-based data warehousing (Redshift and Snowflake).
- Stay current with tech trends, experiment with new technologies, and mentor other engineering team members.
- Collaborate with digital product managers to deliver robust cloud-based solutions that drive powerful customer experiences.
- Perform unit testing and conduct code reviews to ensure quality, performance, and maintainability.
Required Qualifications
- Bachelor’s Degree
- At least 4 years of experience in application development (internship experience does not apply)
- At least 2 years of experience in big data technologies
- At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud)
Preferred Qualifications
- 7+ years of experience in application development including Python, SQL, Scala, or Java
- 4+ years of experience with a public cloud (AWS, Microsoft Azure, or Google Cloud)
- 4+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, etc.)
- 4+ years of experience working on real-time data and streaming applications
- 4+ years of experience with NoSQL implementations (MongoDB, Cassandra)
- 4+ years of data warehousing experience (Redshift or Snowflake)
- 4+ years of experience with UNIX/Linux, including basic commands and shell scripting
- 2+ years of experience with Agile engineering practices
Benefits & Perks
- Compensation: Competitive salary ranges offered – McLean, VA: $193,400 - $220,700; Richmond, VA: $175,800 - $200,700, along with performance-based incentive compensation (cash bonuses and/or long term incentives).
- Benefits: Comprehensive, competitive, and inclusive health, financial, and other benefits that support your total well-being.
Required Skills
Scala
Big Data
Agile
Redshift
Linux
Snowflake
Kafka
Java
Python
Distributed Microservices
SQL
AWS
Spark
Hadoop