Lead / Senior Data Engineer

Sumeru Global Technologies Private Limited17 days ago
Boston, MA, United States
Hybrid
Full-time
Junior Level (1-3 years)

Job Description

Must Have Skills:

2-5 yrs genuine “Modern Data Platform” engineering experience. Fabric is strongly preferred, but happy to consider strong Databricks/Snowflake or similar engineers. Python/Pyspark engineering. Data processing (ETL/ELT). SQL. Data modeling. Data architecture concepts/patterns. Cloud platform engineering/support.

Investment compliance knowledge, financial services, asset management

Requirements:

  • MS Fabric experience/understanding
  • Working experience in Azure for data ingestion
  • Azure Data Factory
  • API based ingestion
  • data storage formats
  • warehouse and Lakehouse
  • handling csv, Json, parquet file formats
  • data modelling
  • medallion architecture
  • optimized transformations using PySpark

Pay:

$80.00 - $110.00 per hour

Benefits:

  • 401(k)
  • Health insurance

Work Location:

Hybrid remote in Boston, MA 02111

Required Skills

Modern Data Platform Engineering
Azure Data Factory
Data Architecture Concepts
Cloud Platform Engineering
Data Storage Formats
Data Processing (ETL/ELT)
Lakehouse
Parquet File Formats
JSON
Handling CSV
Snowflake
Pyspark
Optimized Transformations with PySpark
Data Warehouse
MS Fabric
Databricks
SQL
Medallion Architecture
API Based Ingestion
Python
Data Modeling