Unknown Company

Lead Data Engineer

pittsburgh, pa • Posted 3 days ago
Hybrid Full Time General

Job TitleInterview: Video Visa: USC, GC (Need a genuine GC Copy, it will be verified) Pittsburgh, PA/Cleveland, OH This is hybrid from day-1DescriptionInitiatives/Projects: Optimizing the existing application to reduce spend year over year.Industry BackgroundBanking/financial is preferredTeam DynamicWorking in a crew of 11-12Roles and ResponsibilitiesInteract with business to understand the requirement on a daily evolving need and adapt to the needs. Able to understand the business requirements, tech stack involved and guide the team towards integral solution approach. Dedicated and committed approach, with good communication skills and participation in agile ceremonies.

Experience with object oriented programming including limitations. Familiarity with cross-platform development Able to handle all the database storage and retrieval mechanisms on Data Lake Platforms and extensive experience in handling. Extensive Unix/FTP/File handling Strong hands-on experience with SQL databasesMust Have Technical SkillsA deep understanding and multi-process architecture and the threading limitations of Python. Pyspark data engineering skills Experience using libraries like Pandas, NumPy and MatPlotLib. With experience working with file based systems (supporting csv/parquet/) Extensive knowledge in understanding data and creating data pipelines Hands on experience designing and implementing APIs Hands on experience building microservices using FastAPI or related technologies.

Experience writing unit testing and ensure code coverage.

Experience with Agile Methodology/JIRA/Confluence Experience in version control using GitFlex Skills/Nice to HaveAdded advantage if worked on Big Data, PySpark librariesSoft SkillsExcellent written and verbal communication skills Team player

Back to Job Search