Senior Data EngineerYou will be the Financial Engineer that we hire with cloud experience, and our goal for you is to help us understand best practices for building data pipelines, warehouses and databases in the cloud, and lead the engineering efforts for this new project.As a Data Engineer, you will implement the data models and data structures needed for each use case, in the most convenient format to be used by the Data Science and Business Intelligence teams. Through regular interactions with stakeholders and functional business unit leaders, you will build high-performance data pipelines, tools, and a platform that influences data storage, ingestions, and usage. Additionally, you will participate in data requirements, modeling and testing activities.
Each day will be unique, requiring an ability to think strategically and on your feet, be creative, take initiative, and employ a diverse set of skills.What You'll Be DoingLead the effort to democratize data, building out a cloud-based data platform, providing the right endpoints for the right user (e.g. report, API, table, etc.)Assist in standardizing our data management best practices, including codebase management, work and issue tracking, testing and quality control/assurance measures, data dictionaries, and a documentation hub for both production level code and ad hoc analyses.Interact with stakeholders and functional subject matter experts to understand and gather requirements to develop effective data models that can be translated into business insights reports/analysesCreate data models and data processes, providing the right format and structure for use case solutions.Build and deploy pipelines to ingest and transform in our rapidly growing data platformPartner with IT and Functional Teams on internal/external data integration and acquisitionResearch modern technologies and frameworks to Client uses for new and existing data.Propose and effect changes to our data generation processesProduce clean, well-tested, and documented codeSkills We're Seeking3+ years of experience with Data Engineering, building out robust Data PipelinesExperience doing data engineering in cloud-based environments (this will be a greenfield environment where you will be recommending which cloud(s) to use based on the business goals – so any cloud is fine, but we are a Microsoft shop generally)Strong experience utilizing SQL based data management systems (preferred NoSQL experience as well)Experience writing software in one or more languages: Python, Java, C++Experience with Stakeholder interactionNice To Have ExperiencePreferred experience with data platforms and technologies such as Kafka, Presto, Delta Lake, Spark, etc.Bachelor's Degree in Computer Science, IT or a related field