SC CLEARED Azure Databricks Technical Consultant

We are looking for an experienced Azure Databricks Technical Consultant to design and deliver secure, scalable data and analytics solutions within a complex, highly regulated environment. The consultant will have a strong background in Azure Databricks and modern data engineering, working across large-scale data ingestion, transformation, analytics and AI workloads. The role will involve integrating structured and unstructured data from multiple sources, including telemetry, operational datasets, OSINT and SOCMINT. Key ResponsibilitiesDesign, build and maintain scalable data pipelines using Azure Databricks, Spark/PySpark and Azure Data Lake StorageIngest, transform and process large volumes of structured, semi-structured and unstructured data from multiple sourcesDevelop secure Lakehouse architectures and reusable data engineering frameworks within AzureDesign and optimise data models, analytical datasets and feature stores supporting advanced analytics and AI use casesIntegrate Databricks with Azure Machine Learning, Azure OpenAI and wider Azure data servicesSupport AI/ML and agentic AI workloads including RAG, LLMs and autonomous agent architecturesDevelop analytical solutions incorporating machine learning, NLP, graph analytics, clustering, entity resolution and pattern analysisImplement MLOps, AIOps and SecML processes covering model monitoring, governance, audit logging, explainability, drift detection and rollbackWork with graph technologies including Neo4j, Azure ..... full job details .....