Data Engineering Manager

Tredenceabout 1 year ago
San Jose, California, United States
Hybrid
Full-time
Junior Level (1-3 years)

Job Description

Position Overview

Tredence Inc. is seeking a Data Engineering Manager to lead the design, development, and management of enterprise-level data solutions. Based at 1900 Camden Ave., Suite 66, San Jose, CA 95124, you will oversee scalable cloud data warehouse architectures, data pipelines, and end-to-end project execution. Collaborate with cross-functional teams and leverage automation and CI/CD methodologies to build robust data ecosystems. To apply, please email your resume to Aamir.malik@tredence.com. Reference job code [D06258-01].

Key Responsibilities

  • Design and develop enterprise-level data warehouse and data mart models with a strategic approach.
  • Create logical and physical data models by analyzing project needs, system architecture, and deadlines.
  • Architect scalable and resilient cloud data warehouse solutions optimized for high-throughput data ingestion and processing.
  • Design structured and semistructured data pipelines with efficient landing and aggregation layers to manage large data volumes cost-effectively.
  • Oversee end-to-end project execution by gathering business requirements and identifying potential challenges while working closely with product managers to prioritize tasks.
  • Collaborate with enterprise architects to align platform strategy and architecture as needed.
  • Lead a team of data engineers by providing technical direction, mentorship, and performance oversight.
  • Leverage CI/CD methodologies to automate cloud infrastructure deployment and maintain efficient process workflows.
  • Build and automate workflows for both batch and real-time streaming data pipelines using Python on AWS.
  • Facilitate seamless data provisioning to cloud-based data warehouses.
  • Design and implement AWS-based solutions to support data processing, storage, and orchestration, ensuring scalable and efficient ETL workflows.
  • Review code deliverables, recommend optimizations for performance enhancement, and establish best practices for data quality and transformation.
  • Analyze and troubleshoot ETL defects and production issues, providing comprehensive root cause analysis to stakeholders and leadership teams.
  • Support defect resolution during system integration and user acceptance testing (UAT) by assisting in troubleshooting and validation efforts.
  • Develop and maintain dynamic, interactive dashboards and reports using visualization tools.

Required Qualifications

  • Bachelor’s degree (or foreign equivalent) in Information Technology or a related field.
  • Minimum of five (5) years of experience in a similar role.
  • Demonstrable knowledge of Snowflake, AWS Cloud, Python, Apache Airflow, and Databricks.
  • Willingness to travel approximately 30% to unanticipated client locations throughout the U.S.
  • Ability to telecommute from any location within the U.S.

Benefits & Perks

  • Compensation: $388,918

Required Skills

Python
Snowflake
Data Modeling
ETL
Team Leadership
Databricks
Apache Airflow
Data Warehousing
Cloud Infrastructure Deployment
Real-time Streaming
CI/CD
AWS Cloud