Data Engineer at Software Guidance & Assistance, Inc. (SGA, Inc.) San Jose, CA
Software Guidance & Assistance, Inc. (SGA, Inc.)about 1 year ago
San Jose, California, United States
Hybrid
Full-time
Junior Level (1-3 years)
Job Description
Position Overview
Software Guidance & Assistance, Inc. (SGA, Inc.) is seeking a highly skilled Senior Data Engineer for a contract assignment with one of our premier SaaS clients in San Jose, CA or Seattle, WA. This hybrid role requires you to design and maintain scalable data pipelines, orchestrate workflows, and develop dashboards that empower data-driven decision-making. Compensation is competitive with a base pay range of $60.00/hr - $70.00/hr based on your skills and experience.
Key Responsibilities
- Design, build, and maintain robust data pipelines to support analytics and dashboarding needs.
- Collaborate with stakeholders to gather business requirements and translate them into actionable data solutions.
- Develop modular and efficient ETL workflows using orchestration tools.
- Ensure comprehensive documentation for maintainability and knowledge sharing.
- Build and deploy cloud-native applications (AWS, Azure, or GCP) with a focus on cost optimization.
- Write scalable, distributed data processing code using PySpark, Python, and SQL.
- Integrate with RESTful APIs to consume and process external data services.
- Create high-performance dashboards using Tableau or Power BI.
Required Qualifications
- 10+ years of experience building scalable data pipelines and analytical dashboards.
- Proficiency in SQL, PySpark, and Python for Big Data processing.
- Strong experience with cloud platforms and data warehousing technologies (e.g., Databricks, AWS, Azure, or GCP).
- Expertise in workflow orchestration tools (e.g., Airflow, AWS Glue).
- Experience designing architectures for complex workflows including data privacy and deletion strategies.
- Proven ability to reduce technical debt and automate data workflows.
- Deep understanding of data privacy, governance, and compliance.
Preferred Qualifications
- Familiarity with anomaly detection, monitoring, and alerting systems.
- Skilled in performance tuning for dashboards and queries.
- Knowledge of Medallion Architecture and Delta Live Tables.
- Demonstrated ability to quickly adapt to new technologies and environments.
- Self-starter with a proven track record of delivering high-quality solutions with minimal ramp-up time.
Required Skills
Tableau
ETL workflows
AWS
RESTful APIs
PySpark
Python
Airflow
AWS Glue
Medallion Architecture
SQL
Databricks
Scalable data pipelines
Azure
GCP
Delta Live Tables
Performance tuning
Power BI