Data Engineer Lead***ONLY SUBMIT CANDIDATES WITH PREVIOUS LEAD EXPERIENCE***Work Location: Horsham, PA/HybridInterview Process:Initial Phone ScreenTeam InterviewHand-on Development ExerciseSummary:This role will be responsible for transforming extensive and complex data into consumable business capabilities.Create system architecture, design, and specification using in-depth engineering skills and knowledge to solve complex development problems and achieve engineering goals.Determine and source appropriate data for a given analysis.Work with data modelers/analysts to understand the business problems they are trying to solve, then create or augment data assets to feed their analysis.Acts as a resource and mentor for colleagues with less experience.Lead a team of data engineers through a modernization project of moving on-premise big data implementation to cloud.Core Responsibilities:Lead a team of data engineers to develop data products and tools, explore new technologies, and continually improve tools and processes.Hands-on experience working with Data Analysis and Architecture, Spark, PySpark, Python, Sqoop, Hive, No SQL Data Stores, Object Store, Design and Development of APIs, Kafka.Must be an experienced Python developer with experience in developing frameworks and enforcing best practices.Create business value by leading the design, get your hands dirty, write code, and ultimately deploy big data and machine learning capabilities.Possess expert knowledge in performance, large-scale data distributed system scalability, system architecture, and data engineering best practices.Give the highest priority to operational excellence, evaluate system performance, security, design system metrics, and driving quality improvements.Provide leadership, work collaboratively, and be a mentor in a fantastic team.Required:MUST have Lead experience, Data Analysis and Architecture, Spark, PySpark, Python, Sqoop, Hive, Azure, Google Dataproc, Databricks, No SQL Data Stores, Object Store, Design and Development of APIs, Kafka, Agile skills.Must have Databricks, Snowflake, Azure/Google Dataproc experience.Your expertise is deep and broad; you’re hands-on, producing both detailed technical work and high-level architectural designs.8+ years of recent hands-on in an object-oriented language (Java, Scala, Python).8+ years of experience designing and building data pipelines and data-intensive applications.Experience using Big Data frameworks (e.g., Hadoop, Spark), databases for complex data assembly and transformation.Experience designing and implementing complex big data implementation using Databricks, Snowflake, Azure, Google Dataproc.Preferred:Experience working with Healthcare data is a plus.
Unknown Company