Databricks ArchitectResponsibilities:Define and own the architecture of data platforms built on Databricks, covering ingestion, transformation, storage, and consumption layers.Design and implement Lakehouse architectures with Delta Lake, Unity Catalog, and structured streaming.Architect scalable ETL/ELT pipelines using Apache Spark, PySpark, Scala, and Databricks Workflows.Lead integration with enterprise systems including data catalogs, ML platforms, BI tools, and cloud services (Azure, AWS, GCP).Guide teams on implementing CI/CD pipelines, version control, and automated testing for Databricks notebooks and jobs.Collaborate with data scientists, engineers, and stakeholders to support ML lifecycle management using MLflow and Databricks DBRX, Mosaic AI, etc..Provide thought leadership in performance tuning, cost optimization, and cluster configuration for Databricks environments.Conduct architectural reviews, code audits, and mentoring sessions for engineering teams.Ensure data security, governance, and compliance with Unity Catalog and industry standards.Monitor and troubleshoot Databricks environments and proactively implement maintenance and optimization strategies.Develop reference architectures, reusable components, and documentation.