Azure databricks Azure Data Factory ADF Azure SQL ADLS

7-11 years

Job description

Primary Skills Azure databricks Azure Data Factory ADF Azure SQL ADLS

Secondary Skills Data Warehouse ConceptDBTPython PowerBI

JD

10 years of experience of working on Azure and Databricks Lakehouse implementation with grasp of following

Have experience in building Databricks Lakehouse from a modelling and transformation ELT perspective

Analyze and understand the ETL workflows

2 Experience in SQL programming Pyspark Python or more years experience working as a Data Engineer Experience of developing in the Azure Modern Data Warehouse platform e g Azure Data Lake Azure Data Factory Azure Databricks Databricks Delta Lake etc

3 Experience handling structured and unstructured datasets

4 Good knowledge of DevOps and Github tools and deployment processes Automating data pipelines through a CI CD delivery methodology

5 Expertise on Databricks delta lake implementation Databricks architecture and configuration

6 Expertise in Azure Data Factory building pipelines and orchestration

7Should have prior experience doing SQL server migration to cloud

8Prior experience of migrating on premise SQL Server to Delta lake

9Expertise in Databricks Expert in ETL Pipelines

10In depth hands on implementation knowledge on Azure Databricks Delta Lake Delta table Managing Delta Tables Databricks Cluster Configuration Cluster policies

11Good Understanding of data modelling for data lake

12Oracle PL SQL knowledge a plus

Skills

Mandatory Skills : Azure Data Factory .