Go Anywhere SFTP Data EngineerMaintain robust data pipelines for ingesting and processing data from various sources, including SFTP servers. Implement and manage automated SFTP data transfers, ensuring data security, integrity, and timely delivery. Configure and troubleshoot SFTP connections, including handling authentication, key management, and directory structures. Develop and maintain scripts or tools for automating SFTP-related tasks, such as file monitoring, error handling, and data validation. Collaborate with external teams and vendors to establish and maintain secure SFTP connections for data exchange. Ensure compliance with data security and governance policies related to SFTP transfers. Monitor and optimize SFTP performance, addressing any bottlenecks or issues. Document SFTP integration processes, configurations, and best practices. Responsible for providing monthly SOC controls.
Experience with Solimar software. Responsible for period software updates and patching. Manage open incidents. Responsible for after-hours and weekends on-call duties. Minimum (3-5) years related work experience.
Experience with Microsoft Software and associated server tools.
Experience with GoAnywhere managed file transfer (MFT) solution.
Experience with WinSCP.
Experience with Azure Cloud. Proven experience in data engineering, with a strong emphasis on data ingestion and pipeline development. Demonstrated expertise in working with SFTP for data transfer and integration. Proficiency in scripting languages (e.g., Python, Shell) for automating SFTP tasks. Familiarity with various SFTP clients, servers, and related security protocols. Understanding of data security best practices, including encryption and access control for SFTP.
Experience with cloud platforms (e.g., AWS, Azure, GCP) and their SFTP integration capabilities is a plus. Strong problem-solving and troubleshooting skills related to data transfer and integration issues.