Data Management ProgrammerInstrument Digital Twin is virtual representation of actual instrument. The data will be captured from the instrument and will reside in the Digital Twin. The project revolves around creating a platform using AWS technologies for the data lifecycle.The Data Management Programmer (DMP) will provide support development activities for R&ED data for Instrument Digital Twin Project.
The DMP will support various platforms and integrations, and will manage electronic data collection and access, all in accordance with BMS policies and project deliverables. The scope of work includes development and testing around data cataloging, lifecycle management, data quality analysis, metadata management (parsing, transformations, extraction), data enrichment through scripting, as well as contribute to solution design. The DMP will contribute to the solution performance (analysis/testing).
The DMP will be an integral part of a small team focusing exclusively on scientific data in the IDT project and contribute to the implementation roadmap defined by various business cases.The successful candidate will actively work towards solving business needs identified in the scope below.Role and ResponsibilitiesDevelopment of data catalogs, data access and provisioning, data transfers (internal and external), metadata management and data findability solutionsProvide technical expertise for managing large volume of data from multiple sourcesContribute to the development of policies, procedures and best practice methodologiesEnsure that external and internal regulations and policies governing data management and data systems are metAssist in the development of methodologies to conduct data tracking and quality assuranceAssist in establishing data standardsExperienceBS/MS in STEM (Computer Science, Bioinformatics, Engineering)3+ years of relevant industry experience managing dataExperience/expertise in the acquisition and management of data from multiple sourcesExperience/expertise in management and programming of an electronic data capture systemsRequirements:Experience with different databases, RDBMS and NoSQLProficient with programming in Python/JavaExperience in Linux/Unix scriptingExperience with automating scripts and working in the terminalExperience with AWS Cloud technologies like lambda, S3, SQS, elastic search, IAM etcKnowledge of AWS infrastructure technologies like EC2, RDS etcUnderstanding of data modeling and building ETL pipelinesKnowledge of data management fundamentals and data storage principlesKnowledge of iRods or data cataloging system.