Senior Data/Platform Engineer

Job Description: Duties and Responsibilities Lead solution design activities, collaborating with peers and mentoring junior colleagues to define and execute the team backlog. Develop, test, and document scalable ETL/ELT data pipelines and workflows using Databricks and Azure Synapse to ingest and transform data from a variety of sources. Administer and maintain Azure data platform components including Synapse, Databricks, ADLS Gen2, Key Vault, networking (VNets, NSGs, Managed Private Endpoints) and access control (RBAC, ACLs). Manage infrastructure-as-code across Dev, Staging, and Production environments using Pulumi (and equivalents such as Terraform/Bicep). Design and operate CI/CD pipelines using GitHub Actions (with OIDC federation) and/or Azure DevOps, supporting trunk-based development practices. Administer Databricks workspaces - cluster policies, Secret Scopes, Repos/Git integration, Workflow job health, and Unity Catalog governance. Monitor platform and pipeline health using Azure Monitor, Log Analytics, KQL, and Azure Dashboards; triage and resolve incidents. Implement robust data security and ensure compliance with data privacy regulations; manage service principals, Managed Identities, and least-privilege access. Carry out routine platform operations: patching, backups, storage life cycle, tagging, access reviews, DR readiness, and runbook execution. Identify and address performance bottlenecks and data quality issues to ensure data accuracy and reliability. ..... full job details .....