Over 8 Years of experience in IT.
- Design and implement end-to-end lifecycle of Databricks platform on AWS.
- Good experience in working with Healthcare Insurance.
- Design and implement different environments like Dev/SIT/UAT/PROD for Databricks.
- Expertise in AWS
- Implement data access controls, Lineage and auditing using Unity catalog.
- Implement CI/CD pipelines between different environments.
- Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments.
- Deep expertise in Apache Spark, Delta Lake, SQL, and cluster resource management.
- Translate business requirements into technical blueprints, run proof-of-concepts (POCs), and guide engineering teams on best practices
- AI/ML Enablement, experience in setting up AI and Genie for Databricks.
- Experience with Delta lake house, Unity catalog, DBX notebooks, Python, Pyspark, Genie, Databricks Apps.
Thanks and Regards,
Aju
Shakti Group Inc
Email:
Databricks Engineer in chicago at Unknown Company
This position is listed as full time and onsite.