Senior Data Engineer with Databricks SQL PySparkMy client is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, the company brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 90,000 talented and entrepreneurial professionals across more than 30 countries.Location: Hartford, CT / Atlanta, GAJob Type: C2COverview: Data Migration Engineer having an experience migrating data from on prem to cloudMust Have: Databricks SQL PySparkGood to have: AWS DBTRequirements:Candidate must be experienced working in projects involving data migration on AWS databricks and pythonExperience on data migration from Onpremises databases to AWS Cloud on S3 using databricksUnderstands where to obtain information needed to make the appropriate decisionsDemonstrates ability to break down a problem to manageable pieces and implement effective timely solutionsIdentifies the problem versus the symptomsManages problems that require involvement of others to solveReaches sound decisions quicklyDevelops solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unitRoles and responsibilities:Build and operationalize complex data solutions correct problems apply transformations and recommending data cleansing quality solutionsDesign complex data solutionsPerform analysis of complex sources to determine value and use and recommend data to include in analytical processesIncorporate core data management competencies including data governance data security and data qualityCollaborate within and across teams to support delivery and educate end users on complex data products analytic environmentPerform data and system analysis assessment and resolution for complex defects and incidents and correct as appropriateTest data movement transformation code and data componentsDemonstrate domain expertise including understanding technical concepts necessary and industry trendsHighly proficient use of tools techniques and manipulation including Cloud platforms programming languages and a full understanding of modern software engineering practicesSkills:Mandatory Skills: AWS MWAA, Apache Airflow, Athena, Aurora, QuickSight, RDS, Redshift, AWS DMS, AWS EMR, AWS Glue, AWS Lambda, AWS S3, AWS Step Functions, Dimensional Data Modeling, Dynamo DB, Java, Python, Scala.Disclaimer: E-Solutions Inc.
provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. We especially invite women, minorities, veterans, and individuals with disabilities to apply.