Platform Architect / Platform Lead – Azure Databricks

Job Location: Abu Dhabi, UAEExperience: 7+ YearsJob RoleJob Role: Platform Architect / Platform Lead ? Azure DatabricksRole SummaryOwn the end-to-end architecture, governance, security, and evolution of an enterprise-scale Azure Databricks Data Intelligence Platform, ensuring scalability, performance, cost optimization, and AI enablement.Key ResponsibilitiesDefine end-to-end Lakehouse architecture covering ingestion, storage, processing, orchestration, analytics, and AIDesign and govern Unity Catalog (catalogs, schemas, access control, lineage, auditing)Establish standards for declarative pipelines, workflows orchestration, and runtime governanceDefine governance framework for ML, Feature Store, AI capabilities, and analytics workloadsOwn Azure integrations including identity, networking, key management, and secure data accessImplement compute, cluster, and cost governance (policies, sizing, concurrency, spend control)Review and approve architecture designs for security, scalability, and cost efficiencyOversee CI/CD governance and platform change managementLead performance optimization for Spark, streaming, and AI workloadsDrive controlled adoption of new platform features and best practicesCommunicate architectural strategy to technical and business stakeholdersRequired Skills & ExperienceStrong expertise in Azure Databricks, Spark, PySpark, and Lakehouse architectureDeep knowledge of Unity Catalog, Delta Lake, and platform governance frameworksExperience with orchestration, declarative pipelines, and workload optimizationHands-on exposure to ML lifecycle management and AI platform integrationStrong understanding of Azure identity, networking, and security architectureExperience implementing cost governance and performance tuning strategiesCI/CD governance and DevOps best practices experienceProven ability to design scalable, secure, enterprise-grade data platforms#J-18808-Ljbffr