Design, develop, and maintain ETL pipelines using Databricks, PySpark and ADF to extract, transform, and load data from various sources.
Must have good skills in Pyspark , Programming, code remediation etc.,
Must have good working experience on Delta tables, deduplication, merging with terabyte of data set
Optimize and fine-tune existing ETL workflows for performance and scalability. 2 to 3 years of experience in ADF is desirable (Medium expertise require)
Must have experience on working with large data set
Proficient in SQL and must worked on complex joins, Subqueries, functions, procedure
One should be self-driven and work independently without support
SKILLS
NA
Similar jobs
14 years of hands on experience NA Should have 12+ years experience as Solution architect for SharePoint online NA Project Manager with .<br><br>NET backround Senior Software Engineer-Salesforce Dev Responsibilities: Collaborate with business stakeholders to understand their needs and then implement the... Expand NA Manager Infrastructure Architecture NA Manager Infrastructure Architecture Design, develop, and maintain ETL pipelines using Databricks, PySpark and ADF to extract, transform, and load data from various... Expand NA
Min 3+ years of experience as Architect
Understand of the overall solution, application... Expand
Experience in designing architecture for SharePoint... Expand
Posted On: 21-11-24
.png&w=256&q=75)
Posted On: 18-11-24
Posted On: 15-11-24
Posted On: 15-11-24
