• Azure 70% + Big data 30%5+ years Experience Python in developing Data Engineering pipelines.
• Strong experience in Spark and PySpark; Performance tuning, RDD Functions development
• Spark experience should be complemented with strong fundamentals on Big Data ecosystem and cluster managementExperience working with databases (SQL, PostgreSQL) or any relational or Columnar Databases
• Experience working with APIs, REST API and integrating with ADF pipelines
• Proven experience configuring and performance tuning large Spark clusters in high-demand workload environments
• Responsible for working with the Data Platform in understanding pipeline development needs in Integration and work closely with Architecture teams to Design, Build and deploy into target environments
• Should be familiar with CI/CD pipelines, DevOps concepts and know how to worj with fellow developers in managing branches during development lifecycle
• Excellent communication and collaboration skills

Must have 70% azure , 30% Bigdata skills

Notice period - upto 45 days