Sr Data Engineer
Apolloseabout 1 year ago
San Jose, California, United States
Remote
Full-time
Junior Level (1-3 years)
Job Description
Key Responsibilities
- Engage in scrum ceremonies including Daily Standups, Sprint Planning, Retrospectives, and Demos.
- Collaborate daily with your development team, sharing progress and offering support to one another.
- Design, develop, and maintain highly scalable and extensible data pipelines from internal and external sources.
- Test and validate models developed by fellow team members to ensure high data quality and adherence to development standards.
- Collaborate with cross-functional teams to design, develop, and deploy data-driven applications and products.
- Optimize data queries, models, and storage formats to support common usage patterns.
- Work with the data science team to enhance machine learning algorithms and platforms.
- Define and automate data quality checks and develop data solutions, including data visualization tools.
- Contribute to the definition and management of data governance standards and policies.
- Participate in prototyping emerging technologies for data ingestion, transformation, and distributed file systems within a cloud-native big data platform.
- Stay up-to-date with industry trends and best practices in data engineering and cloud computing.
Required Qualifications
- Communication
- Big Data
- SQL Skills
- Data Modeling Techniques
- Python Skills
- Hadoop for Big Data Skills
- AWS Cloud Services Skills
Required Skills
Data Modeling Techniques
SQL
Hadoop
Python
Big data
Communication
AWS Cloud Services