22 ago
|
Unison Group
|
Veglio
22 ago
Unison Group
Veglio
pulliETL/ELT development /liliModel deployment /li /ulpWe are seeking a Senior Databricks Architect to design, implement, and optimize enterprise-scale data platforms using the Databricks Lakehouse Platform. The ideal candidate will have deep expertise in Databricks architecture, Apache Spark, Delta Lake, data engineering, cloud platforms, and enterprise data solutions. /ph3Key Responsibilities /h3ulliDesign and architect Databricks Lakehouse solutions for large-scale enterprise data platforms /liliLead end-to-end Databricks implementation, including architecture, development, deployment, and optimization /liliDefine Databricks workspace architecture, cluster strategies, security models, and operational standards /liliDesign and develop scalable data pipelines using Databricks, Apache Spark, PySpark, SQL, and Delta Lake /liliImplement data ingestion frameworks supporting batch and real-time data processing /liliDesign Delta Lake architectures including: /liulliDelta tables /liliMedallion architecture (Bronze/Silver/Gold layers) /liliData quality frameworks /liliSchema evolution and optimization /li /ulliPerform Databricks performance tuning: /liulliCluster optimization /liliSpark job optimization /liliQuery tuning /liliCost optimization /li /ulliImplement Databricks governance and security using: /liulliUnity Catalog /liliAccess controls /liliData lineage /liliAudit capabilities /li /ulliLead migration projects from legacy data platforms to Databricks Lakehouse /liliDefine best practices for Databricks CI/CD, DevOps, and environment management /liliCollaborate with data engineers,
data scientists, analysts, and enterprise architects /liliProvide technical guidance, architecture documentation, and design reviews /li /ulh3Skills Experience /h3ulliStrong experience in data engineering, big data, or solution architecture /liliStrong hands-on experience with Databricks Platform /liliExpert knowledge of: /liulliApache Spark /liliPySpark / Scala /liliDelta Lake /liliSQL /liliData Lakehouse architecture /liliETL/ELT development /li /ulliExperience designing and delivering enterprise Databricks solutions /liliStrong experience with cloud platforms: /liulliAzure Databricks (preferred) /liliAWS Databricks /liliGoogle Cloud Databricks /li /ulliExperience with: /liulliDatabricks Workflows /liliJobs orchestration /liliNotebooks /liliRepos /liliCluster management /liliUnity Catalog /li /ul /ulh3Preferred Skills /h3ulliDatabricks Certified Data Engineer Professional / Databricks Certified Architect /liliExperience with: /liulliMLflow /liliDatabricks Machine Learning /liliFeature Store /liliModel deployment /liliMLOps /li /ulliKnowledge of streaming technologies: /liulliStructured Streaming /liliKafka /li /ulliExperience with data governance, compliance, and enterprise security frameworks /li /ulh3Key Competencies /h3ulliStrong Databricks architecture and implementation expertise /liliAbility to design scalable and cost-efficient Lakehouse solutions /liliStrong troubleshooting and performance optimization skills /liliAbility to lead technical discussions with enterprise stakeholders /li /ul /p #J-18808-Ljbffr
📌 Senior Databricks Solution Architect (Veglio)
🏢 Unison Group
📍 Veglio