Sr. Data Engineer (SCM)Location: Bay Area, CA (Hybrid/Remote) Duration: Long Term ContractDescription:Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)Apply proven expertise and build high-performance scalable data warehousesSecurely source external data from numerous partnersIntelligently design data models for optimal storage and retrievalDeploy inclusive data quality checks to ensure high quality of dataOptimize existing pipelines and maintain of all domain-related data pipelinesOwnership of the end-to-end data engineering component of the solutionExperience in creation of data pipelines using Python.Python for data manipulation & transformation (python dictionaries, data frames, data stream, joins of all kinds, outside of SQL IDEs)Research skills – go figure it out and come back with working model. Pros/cons analysis skillsStrong work ethic, independent problem-solving skills, self-motivated, comfortable with startup cultureExcellent and crisp communicatorMust have domain experience in supply chain (E-commerce /manufacturing etc)Minimum Qualifications:BS/MS in Computer Science or a related technical field10+ years of Python or other modern programming language development experience10+ years of SQL and relational databases experience10+ years experience in custom ETL design, implementation and maintenance5+ years of experience with workflow management engines (i.e.
Airflow, Luigi, Prefect, Dagster, Digdag, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M)