Experience in building data pipeline and data engineering
Atleast 7 years plus experience with 4+ in US markets
Good Knowledge of Data Brick lakehouse and Azure DataLake concept
Knowledge of Data Bricks delta concept– Delta live tables (DLT)
Strong hands-on experience in ELT– pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and zure Serverless SQL Pool.
Experience with data transformation using Spark, and SQL technologies.
Strong problem-solving and debugging skills in ETL workflows and data pipelines.
Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing. Nice to Have
- Experience in US Insurance clients and Power BI analysis"