Lead / Senior Data Engineer
Sumeru Global Technologies Private Limited17 days ago
Boston, MA, United States
Hybrid
Full-time
Junior Level (1-3 years)
Job Description
Must Have Skills:
2-5 yrs genuine “Modern Data Platform” engineering experience. Fabric is strongly preferred, but happy to consider strong Databricks/Snowflake or similar engineers. Python/Pyspark engineering. Data processing (ETL/ELT). SQL. Data modeling. Data architecture concepts/patterns. Cloud platform engineering/support.
Investment compliance knowledge, financial services, asset management
Requirements:
- MS Fabric experience/understanding
- Working experience in Azure for data ingestion
- Azure Data Factory
- API based ingestion
- data storage formats
- warehouse and Lakehouse
- handling csv, Json, parquet file formats
- data modelling
- medallion architecture
- optimized transformations using PySpark
Pay:
$80.00 - $110.00 per hour
Benefits:
- 401(k)
- Health insurance
Work Location:
Hybrid remote in Boston, MA 02111
Required Skills
Modern Data Platform Engineering
Azure Data Factory
Data Architecture Concepts
Cloud Platform Engineering
Data Storage Formats
Data Processing (ETL/ELT)
Lakehouse
Parquet File Formats
JSON
Handling CSV
Snowflake
Pyspark
Optimized Transformations with PySpark
Data Warehouse
MS Fabric
Databricks
SQL
Medallion Architecture
API Based Ingestion
Python
Data Modeling