Unknown Company

AWS Databricks Data Engineer Lead

hartford, ct • Posted 4 days ago
Onsite Full Time General

Data Engineer LeadData Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer you will play a key role in growing and transforming analytics landscape.Looking for Data Engineer lead having experience on building ingestion solutions to integrate 3rd party data using databricks.Strong python skillsAWS Cloud infrastructure knowledge commonly used AWS Glue S3 IAM AirflowExperience with building data pipelines using Databricks on AWSKnowledge and hands-on SnowflakeExperience in Agile methodologies and Atlassian tools like JIRAExpertise in using version control tools like Git BitbucketExperience on CICD using Kubernetes GIT and Monitoring and ing toolsExperience on data migration from OnPrem databases to AWS Cloud on S3Acts as a single point of contact for databricks projects for customerProvides innovative and cost-effective solution using AWS databricks pythonDevelops solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unitAs a leader in the Cloud Engineering you will be responsible for the overseeing developmentLearn adapt quickly to new Technologies as per the business needDevelop a team of Operations Excellence building tools and capabilities that the Development teams leverage to maintain high levels of performance scalability security and availabilityUnderstand where to obtain information needed to make the appropriate decisionsDemonstrate ability to break down a problem to manageable pieces and implement effective timely solutionsIdentify the problem versus the symptomsDevelop solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unitThe Candidate must have 35 yrs of experience in Databricks AWS PythonHands on experience on AWS Cloud platform especially S3 Glue LamdaExperience on spark scriptingHas working knowledge on migrating relational and dimensional databases on AWS Cloud platformRelevant experience with ETL methods and with retrieving data from dimensional data models and data warehousesStrong experience with relational databases and data access methods especially SQLKnowledge of Amazon AWS architecture and designBachelors degree or equivalent training with data tools techniques and manipulationFour years of data engineering or equivalent experienceDatabricks-SparkSQL-Scala/Python/JavaData AnalysisData Engineer

Back to Job Search