Databricks Integration Lead (Veeva/Vault CRM)
We are seeking a senior, hands-on Databricks Integration Lead to drive integration architecture for a large-scale migration from Veeva CRM to Vault CRM. This role will oversee the analysis and optimization of 46 integration points across five Veeva CRM environments, establishing scalable integration standards and guiding a distributed engineering team. Strong, recent, hands-on Databricks expertise is essential.
Responsibilities:
- Lead end-to-end integration architecture across Databricks, Veeva CRM, Vault CRM, and connected systems.
- Analyze and rationalize 46 integration points, identifying opportunities to consolidate, standardize, or eliminate integrations.
- Establish Databricks architecture standards, including Delta Lake, medallion architecture, Unity Catalog, orchestration, and CI/CD.
- Define data mapping, migration, and coexistence strategies between Veeva CRM and Vault CRM.
- Review technical designs, notebooks, and pipelines while providing hands-on technical leadership and guidance to engineering teams.
- Establish data validation, reconciliation, monitoring, and cutover strategies within a regulated environment.
Qualifications:
- 10+ years of data integration and architecture experience, including 5+ years of deep, hands-on enterprise Databricks experience.
- Expertise in PySpark, Spark SQL, Delta Lake, Databricks Workflows, Delta Live Tables, Auto Loader, and Unity Catalog.
- Hands-on Veeva CRM data model and integration experience; Vault CRM experience strongly preferred.
- Experience with large-scale, multi-source integration programs involving numerous interfaces.
- Life sciences or pharmaceutical commercial experience, including HCP/HCO data, MDM, call activity, samples, and consent.
- Strong API and data integration experience (REST/SOAP, bulk loads, and event-based integrations).
- Proven ability to lead technical engineering teams, including offshore resources.
- Familiarity with GxP validation and regulated environments.
Preferred: Databricks certifications, Veeva CRM-to-Vault CRM migration experience, Veeva Network/OpenData, and Databricks DevOps tools such as Terraform, Azure DevOps, or GitHub Actions.
Databricks Integration Lead (Veeva/Vault CRM) in Indianapolis at New York Technology Partners
This position is listed as full time and onsite. It was posted 4 days ago.