Technology Partners is currently seeking a talented Principal Data Engineer. Do you have experience designing and implementing complex data architectures using Databricks and Azure cloud ecosystem? Let us help you make your next big career move a reality!
What You Will Be Doing:
As a Principal Data Engineer within our Data Organization, you will serve as one of the most senior technical contributors and a near-expert practitioner in data engineering. You will craft and lead the development of high-scale, performance-critical data pipelines and platforms, primarily leveraging Databricks and Azure. You will embed into multiple engineering teams to unblock and accelerate delivery, while mentoring engineers at various levels to raise technical standards. You will also influence architectural and engineering principles, ensuring alignment with best practices and enterprise standards. Your efforts will help shape our data platform's evolution through deep technical execution and strategic collaboration.
Key Responsibilities:
- Design and implement end-to-end data architectures covering ingestion, storage, transformation, and governance using Lakehouse patterns on Databricks and Azure.
- Write, review, and optimize production code to ensure performance, security, reliability, and cost efficiency.
- Help define and evolve engineering and architectural standards, patterns, and reference implementations across the data organization.
- Mentor and coach data engineers at all levels by conducting code reviews, pair programming, and design sessions.
- Embed into cross-functional Data Engineering teams to lead or accelerate critical projects while transferring expertise and best practices.
- Analyze and address technical risks, design flaws, and execution gaps, providing clear remediation strategies.
- Collaborate with Enterprise Architecture and other stakeholders to ensure solutions meet security, governance, scalability, and cost standards.
- Lead internal technical talks and knowledge-sharing efforts to enhance team-wide expertise.
Required Skills & Experience:
- 3-5+ years of practical data engineering experience with a focus on scalable, enterprise-grade data platforms and pipelines.
- Near-expert proficiency with Databricks, Spark, Delta Lake, Unity Catalog, and the Azure data ecosystem.
- Demonstrated ability to design and implement comprehensive data architectures for complex business environments.
- Proven experience mentoring engineers, influencing teams through technical influence, and setting high standards for engineering excellence.
- Familiarity with modern data architecture patterns such as Lakehouse, medallion, and data mesh, along with DataOps practices.
- Bachelor’s degree or equivalent practical experience.
- High School Diploma or equivalent and a valid Driver’s License.
Desired Skills & Experience:
- Experience contributing across multiple teams as a technical leader or senior contributor.
- Knowledge of advanced cloud data technologies and platform evolution strategies.
- Exposure to enterprise data governance and security standards.
- Additional industry experience in large-scale data environments or related fields.
Pay:
$70.00 – $100.00 /hr
Keywords: Databricks, Azure Data Ecosystem, Spark, Delta Lake, Data Architecture, Data Engineering, DataOps, Lakehouse, Data Mesh, Cloud Data Platforms
We are interested in every qualified candidate who is eligible to work in the United States. However, we are not able to provide sponsorship at this time or accept candidates who would require a corp-to-corp agreement.
All offers of employment at Technology Partners are contingent upon clear results of a thorough background check and drug screening that meet corresponding laws and regulations at the city, state and federal level.
Pay ranges are influenced by candidate qualifications, experience, and role specifics, with the actual rate determined considering skills, market conditions, and are subject to change by the employer; pay negotiations follow all state and federal legal guidelines.
#J-18808-Ljbffr