Job Title: Scala and Spark Developer
Job ID:
Job Location: Austin, TX; Morris Plains, NJ
Job Travel Location(s):
# Positions: 1
Employment Type: W2
Candidate Constraints:
Duration:Long Term
# of Layers:0
Work Eligibility:All Work Authorizations are Permitted – No Visa Transfers
Key Technology:
Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
Job Responsibilities:
- Work with business and technical leadership to understand requirements
- Participate in sprint planning sessions and help TPOs
- Troubleshooting the issues, provide effective solutions and application monitoring in productions environment.
Skills and Experience Required:
- 7+ years of strong development experience in Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
- In depth knowledge on Hadoop architecture and its components
- Strong working knowledge on Single Store (MEMSQL) database
- Should have good hands‑on experience working with Indexes, Shard keys, column store, and reference tables using Single Store database.
- Must understand basic AWS services and hands on experience
- Basic to moderate Terraform development experience needed
- Should be able to demonstrate work experience in Hadoop, Spark, hive
- Strong hands‑on experience on Scala and Spark is must
- Must have work experience on Hadoop as data warehouse/Data Lake implementations
- Strong experience on DevOps pipeline implementation
- Health care domain knowledge is a plus
- Troubleshooting the Hadoop Yarn jobs is must
- Strong experience in writing complex and effective SQLs, and Stored Procedures
- Strong development experience on Single Store database operations
- Strong profiling skills using Single Store database
- Strong query optimizations skills to improve performance of ETL process
- Implement Hadoop job orchestration using Shell scripting, and Airflow
- Experience in Agile and working knowledge on DevOps tools (Get, Maven, Jenkins, Sonar Cube, and Checkmarks)
- Unix Shell scripting and basic administration of Unix servers
- AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and Cloud Watch)
- Experience in Jira and Confluence
- Must participate in production support model.