Sr Data Engineer – DBT & SnowflakeVisa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply.
Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes San Antonio, TX Long TermAbout the Data Engineer RoleAs a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Snowflake cloud data warehouse platform and reporting processes. The ideal candidate should be proficient in writing SQLs so they can be embedded into the Data Build Tool (DBT) for data transformation. Also need to understand the legacy ETL components developed in DataStage, SQL scripts and shell scripts.
Familiarity with AWS and Snowflake CDW platform big plus. Ideal candidate should be willing to learn open source technologies on the fly as job demands.ResponsibilitiesDesign, develop & implement ETL/ELT processes for Cloud Datawarehouse platform SnowflakeAbility to understand legacy DataStage ETL components and rewrite them into SQLs and DBT (Data Build Tool) componentsWork closely with other data engineering teams to ensure alignment of methodologies and best practicesLeverage the common components and CI/CD pipelinesRequirementsBachelor's Degree or master's degree in Computer Science.10+ years of hands-on software engineering experience.2 years of strong ELT experience using Data Build Tool (DBT) loading to Cloud DW Snowflake / Redshift.3+ years of strong ETL experience on either DataStage, Informatica, Ab-Initio, Talend etc. is plusExperience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMSStrong database fundamentals including SQL, performance, and schema design.Proficiency in SQL codingAbility to interpret/write Python scripting is a plus.Experience with AWS platform big plusExperience with Git.Experience building CI/CD pipeline is plusTo be able to work in a fast-paced agile development environment.