Bitsoft International, Inc

Databricks Tech Lead (W2 / USC / GC)

Austin, TX • Posted Today
Hybrid Full Time General

Job Title: Databricks Tech Lead

Location: Multiple Client Locations in US (Hybrid 2 days Onsite/Week)
Duration: 6+ Months
Rate: $Market/Hour W2 only

Eligibility: W2 only Open to US Citizens, Green Card Holders (C2C not allowed)

Description:
As a Tech Lead, you will work closely with business stakeholders, solution architects, product owner, scrum master, and subject matter experts (SMEs) to understand requirements and deliver high-quality, scalable solutions on Azure Databricks.

Position Requirements:
• 7+ years in data/platform/analytics engineering, including 2+ years leading technical teams or workstreams.
• Proven production delivery on Databricks (with strong Azure Databricks experience preferred).
• Strong Apache Spark expertise (PySpark/Scala): distributed processing, troubleshooting, and performance tuning.
• Deep Delta Lake knowledge: ACID tables, compaction, Z-Ordering, schema evolution, and batch/streaming patterns.
• Experience building scalable batch and streaming pipelines, including orchestration/operationalization (scheduling, dependencies, retries, idempotency).
• Strong Azure data platform background, including Azure Data Lake Storage (ADLS) architecture and best practices; familiarity with Azure Data Factory (ADF), Azure Synapse Analytics, and related services.
• Advanced programming skills in Python and SQL, plus hands-on Java experience (e.g., integrations/services or Spark/platform utilities).
• Cloud fundamentals in at least one major platform (Azure/AWS/Google Cloud Platform (GCP)): identity and access management (IAM), storage, networking basics, and cost controls.
• Working experience in Java (e.g., building integrations/services, Spark/streaming components, or platform utilities).

Back to Job Search