GCP Data Engineer-5

Realign LLC9 months ago
San Jose, CA, United States
On-site
Contract
Junior Level (1-3 years)

Job Description

Position Overview

Role: GCP Data Engineer. Job Type: Contract. Job Category: IT. Location: San Jose / Santa Clara, CA (Day 1 Onsite). We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining scalable data infrastructure that drives business intelligence, advanced analytics, and machine learning initiatives. You must be comfortable working autonomously, navigating complex challenges, and driving projects to successful completion in a dynamic cloud environment.

Key Responsibilities

  • Design and Optimization: Design, implement, and optimize clean, well-structured, and performant analytical datasets to support high-volume reporting, business analysis, and data science model development.
  • Pipeline Development: Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence and advanced analytics.
  • Big Data & Streaming: Implement and support Big Data solutions for both batch (scheduled) and real-time/streaming analytics.
  • Collaboration: Work closely with product managers and business teams to understand data requirements and translate them into technical solutions.

Required Qualifications

  • Cloud Platform Expertise (GCP Focus): Extensive hands-on experience in dynamic cloud environments with a strong preference for Google Cloud Platform (GCP) services, including expert-level skills in BigQuery for data ingestion, performance optimization, and data modeling, as well as experience with Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub.
  • Programming & Querying: Expert-level proficiency in Python and a solid command of advanced SQL for complex querying, data processing, and performance tuning.
  • Data Pipeline Orchestration: Prior experience using workflow management and orchestration tools (e.g., Apache Airflow, Cloud Composer, Dagster, etc.).
  • DevOps/CI/CD: Experience with version control (Git) and familiarity with CI/CD practices and tools (e.g., GitLab, GitHub Actions) to automate deployment and testing processes.
  • DEVOPS ENGINEER
  • SENIOR EMAIL SECURITY ENGINEER

Required Skills

BigQuery
Apache Airflow
Google Cloud Platform (GCP)
Git
Pub/Sub
SQL
Python
Cloud Storage
CI/CD
Cloud Dataflow