About BayRock Labs At BayRock Labs, we pioneer innovative tech solutions that drive business transformation. As a leading product engineering firm based in Silicon Valley, we provide full-cycle product development, leveraging cutting-edge technologies in AI, ML, and data analytics. Our collaborative, inclusive culture fosters professional growth and work-life balance. Join us to work on ground-breaking projects and be part of a team that values excellence, integrity, and innovation. Together, let's redefine what's possible in technology.
We are looking for a highly skilled Senior Data Engineer / Data Architect with deep hands-on expertise in Azure, Databricks, PySpark, Python, SQL, and modern data warehousing . This role is ideal for someone who has built large-scale data platforms, designed enterprise-grade architectures, and delivered high-quality data products in cloud environments.
Core Technical Expertise
- Cloud-native architecture design, scalability, and cost optimization
- Security & governance: RBAC, Managed Identity, Private Endpoints
- Lakehouse architecture implementation
- Delta Live Tables (DLT), Unity Catalog
- CI/CD for Databricks workloads
- Apache Spark with advanced PySpark transformations
- Delta Lake architecture & optimization
Programming & Querying
- Python for automation, data engineering, and orchestration
- SQL for complex query optimization and analytics engineering
Data Architecture & Engineering
- Enterprise Data Warehouse (EDW) architecture
- Dimensional modeling (Star/Snowflake)
- Data Vault 2.0 modeling
- Change Data Capture (CDC) implementation
- Medallion architecture (Bronze/Silver/Gold)
- Master Data Management (MDM)
Data Products & Analytics Enablement
- Design and delivery of scalable data products
- KPI frameworks & enterprise reporting enablement
- Integration of ERP, SaaS, and operational systems
- Hybrid Lakehouse + EDW architectures
- Infrastructure as Code (Terraform, ARM templates)
- Automated testing (unit, integration, data quality)
- Monitoring, logging, and observability
Strategic & Leadership Impact
- Technical roadmap planning and execution
- Migration from legacy EDWs (Teradata, Oracle, SQL Server) to Lakehouse
Ideal Candidate Profile
- 5–10+ years of hands‑on experience in data engineering or data architecture
- Ability to lead design discussions, influence architecture decisions, and mentor teams
- Strong problem‑solving mindset and passion for modern data engineering