Lead Databricks Platform Engineer / Solutions Architect

Databricks Platform & Data EngineerNTT DATA is seeking a senior Databricks Platform & Data Engineer to join our Databricks Center of Excellence (CoE). This role blends platform engineering, architecture, and hands-on data engineering, with a focus on building and scaling enterprise-grade Databricks environments for large, regulated clients. The ideal candidate will lead platform setup, governance, and adoption, while partnering directly with clients to design and deliver high-impact use cases leveraging the latest Databricks capabilities (e.g., Dataflow, Unity Catalog, AI/BI, Genie).

This is a client-facing consulting role requiring strong technical depth, communication skills, and the ability to translate business requirements into scalable data platform solutions.Key Responsibilities:Platform Engineering & ArchitectureDesign and deploy enterprise-scale Databricks Lakehouse platforms across AWS/AzureEstablish secure, governed environments using Unity Catalog, role-based access controls, and data lineageDefine platform standards, reusable patterns, and guardrails for scalable adoptionOptimize platform performance, cost, and reliability for production workloadsImplement CI/CD, environment promotion, and DevOps automation for DatabricksDatabricks Feature EnablementLead adoption of modern Databricks capabilities including: Unity Catalog: centralized governance, access control, lineageDataflow / declarative pipelines: build scalable ingestion and transformation frameworksGenie / AI-assisted development: accelerate developer productivity and data accessibilityEnable AI/BI dashboards, model serving, and advanced analytics use casesData Engineering & Use Case DeliveryBuild and optimize batch and streaming data pipelines using Spark and Delta LakeDevelop data products and domain-oriented pipelines aligned to enterprise data strategiesLead end-to-end use case delivery, from requirements to production deploymentDrive data quality, observability, and pipeline reliabilityClient Engagement & AdvisoryAct as a trusted advisor to client stakeholders (architecture, data, risk, and business teams)Translate business requirements into technical architecture and delivery roadmapsLead workshops, solution design sessions, and platform adoption strategiesSupport proposals, solutioning, and client innovations within regulated industriesCoE ContributionBuild and contribute to NTT DATA accelerators, frameworks, and reusable assetsDefine best practices, reference architectures, and playbooks for enterprise Databricks adoptionMentor junior engineers and support capability building across the CoERequired Qualifications:12+ years of experience in data engineering, platform engineering, or data architecture5+ years hands-on experience with Databricks in large enterprise environmentsDeep expertise in: Apache Spark (Scala/Python) Delta Lake and Lakehouse architectures Databricks workspace setup, cluster policies, and job orchestrationStrong experience with cloud platforms (AWS, Azure, or GCP)Experience implementing data governance, security, and compliance controlsProven ability to design and deliver scalable, production-grade data platformsStrong client-facing and communication skillsPreferred Qualifications:Experience in financial services or other regulated industriesFamiliarity with data governance frameworks, regulatory reporting, and risk data environmentsDatabricks certifications (e.g., Data Engineer, Solutions Architect)Experience with: Real-time streaming (Kafka, Structured Streaming) MLOps / Model Serving Data marketplace / data product architecturesExposure to AI-assisted development workflows and agent-based toolingCandidates must be within reasonable commuting distance of or able to relocate to Plano, TX; Minneapolis, MN; Chicago, IL; or Atlanta, GA.