Lead - Data Integration

Hands-on experience working with Azure Data Factory and Databricks, including designing, deploying, and optimizing data pipelines, workflows, and compute clusters Strong proficiency in SQL, with the ability to write efficient queries, troubleshoot issues, and improve performance Experience using a variety of data ingestion techniques and frameworks to integrate data from multiple sources Solid understanding of data architecture and data modelling, with the ability to align solutions to business objectives Good knowledge of ETL processes, covering data extraction, transformation, and loading across different environments In-depth familiarity with the Azure ecosystem and Databricks platform for scalable data solutions Experience implementing CI/CD pipelines to support automated development, testing, and deployment Exposure to integrating AI-driven capabilities to enhance data processing and delivery efficiency ..... full job details .....