Data Engineer (2)Interview: F2F interview Visa: USC, GC, GC EAD, H4, L2 This is hybrid from day 1. Must be local.Description: It is with Client Loyalty. They are building out a scoring engine for their merchants.
Very similar to Rewards for issuers.Downtown San Francisco - Three days in office. T/Th mandatory. 12 Month ContractExperience dealing with large volumes of data, from various sources, both structured and unstructured.Ability to triage and talk through performance/scaling issues of dealing with data at scale.Good understanding of how data will be read (file formats, partitioning, bucketing).Extensive experience writing testable jobs using Spark (or equivalent) framework.Programming & Scripting Languages: Java EE, Scala, Spark, SQL, Bash.Software Architectures (micro-services, event driven, peer-to-peer).Application Security.Asynchronous Pub-Sub and Point to Point Messaging Systems.Streaming within the Hadoop ecosystem is a plus.