Data Engineering Manager
Tredenceabout 1 year ago
San Jose, California, United States
Hybrid
Full-time
Junior Level (1-3 years)
Job Description
Position Overview
Tredence Inc. is seeking a Data Engineering Manager to lead the design, development, and management of enterprise-level data solutions. Based at 1900 Camden Ave., Suite 66, San Jose, CA 95124, you will oversee scalable cloud data warehouse architectures, data pipelines, and end-to-end project execution. Collaborate with cross-functional teams and leverage automation and CI/CD methodologies to build robust data ecosystems. To apply, please email your resume to Aamir.malik@tredence.com. Reference job code [D06258-01].
Key Responsibilities
- Design and develop enterprise-level data warehouse and data mart models with a strategic approach.
- Create logical and physical data models by analyzing project needs, system architecture, and deadlines.
- Architect scalable and resilient cloud data warehouse solutions optimized for high-throughput data ingestion and processing.
- Design structured and semistructured data pipelines with efficient landing and aggregation layers to manage large data volumes cost-effectively.
- Oversee end-to-end project execution by gathering business requirements and identifying potential challenges while working closely with product managers to prioritize tasks.
- Collaborate with enterprise architects to align platform strategy and architecture as needed.
- Lead a team of data engineers by providing technical direction, mentorship, and performance oversight.
- Leverage CI/CD methodologies to automate cloud infrastructure deployment and maintain efficient process workflows.
- Build and automate workflows for both batch and real-time streaming data pipelines using Python on AWS.
- Facilitate seamless data provisioning to cloud-based data warehouses.
- Design and implement AWS-based solutions to support data processing, storage, and orchestration, ensuring scalable and efficient ETL workflows.
- Review code deliverables, recommend optimizations for performance enhancement, and establish best practices for data quality and transformation.
- Analyze and troubleshoot ETL defects and production issues, providing comprehensive root cause analysis to stakeholders and leadership teams.
- Support defect resolution during system integration and user acceptance testing (UAT) by assisting in troubleshooting and validation efforts.
- Develop and maintain dynamic, interactive dashboards and reports using visualization tools.
Required Qualifications
- Bachelor’s degree (or foreign equivalent) in Information Technology or a related field.
- Minimum of five (5) years of experience in a similar role.
- Demonstrable knowledge of Snowflake, AWS Cloud, Python, Apache Airflow, and Databricks.
- Willingness to travel approximately 30% to unanticipated client locations throughout the U.S.
- Ability to telecommute from any location within the U.S.
Benefits & Perks
- Compensation: $388,918
Required Skills
Python
Snowflake
Data Modeling
ETL
Team Leadership
Databricks
Apache Airflow
Data Warehousing
Cloud Infrastructure Deployment
Real-time Streaming
CI/CD
AWS Cloud