Cloud Data Engineer- Azure/Databricks/Snowflake
Location - NYC, NY or Iselin, NJ
12+ months – hybrid 3 days in office / 2 days remote
W2 Rate - $120-122/hr
Key Requirements
- Must have pipeline development, platform setup and configuration experience
- Strong SQL and PySpark skills (must be able to answer SQL merge statements and SCD-related questions)
- MUST HAVE Hands-on experience with Databricks, ADF, and Snowflake platform setup and configuration
- Solid understanding of Azure cloud environment and DevOps/IaC concepts
- Experience with pipeline development and platform configuration of Databricks, ADF and Snowflake
- Ability to explain how and why solutions were implemented – not just tasks completed
- Strong problem-solving, communication, and independent working skills
Day to Day
Databricks -must be able to
- Configure and manage clusters (auto-scaling, runtime versions, troubleshooting)
- Build ETL pipelines with PySpark and Databricks notebooks
- Set up and manage Unity Catalog for data governance
- Optimize performance (Delta Lake tuning, caching, partitioning)
Azure Data Factory (ADF) – must be able to
- Build and manage end-to-end data pipelines
- Connect to multiple data sources (SQL, REST APIs, Blob storage, Snowflake)
- Implement triggers, parameters, variables, and monitoring
Snowflake – must be able to
- Design and maintain data warehouses and ETL/ELT pipelines
- Apply SQL and Data Warehousing concepts (SCD Type 1/2, star schema, partitioning)
- Configure virtual warehouses, access control, and performance tuning
- Integrate with Databricks, ADF, and BI tools
Job Types: Full-time, Contract
Pay: $120.00 - $122.00 per hour
Work Location: In person