Data Engineer With Apache Kafka/Nifi ExperienceAtlas Technologies, Inc., a rapidly expanding company supporting the U.S. Military and other Government entities, is seeking a fast-learning and self-motivated Data Engineer with Apache Kafka/Nifi experience to design, build, and maintain the systems and infrastructure that collect, store, and transform data for the Department of Defense (DoD) and the Naval Information Warfare Center (NIWC). This effort is primarily centered around Data Engineering support for PMW160 Tactical Networks.
This is a hybrid role in North Charleston, SC.You Will:Support designing and building ETL (Extract, Transform, Load) processes and pipelines to move data from disparate sources into centralized repositoriesDevelop automated deployment pipelines and Infrastructure-as-Code templates using scripts and orchestration tools to automate repetitive data tasks, reducing manual intervention and errorDesign and optimize data architectures to improve performance, cost-efficiency, security, and scalabilityDesign and implement large-scale processing systems and database architecture solutions (e.g., Data Lakes, Data Warehouses)Provide recommendations for data engineering best practices and process improvementsContribute to team objectives and support data engineering initiativesPrepare technical documentation and present architecture proposals to engineering teamsPartner with other engineering groups to understand their data requirements and with leadership to align technical infrastructure with mission objectivesYou Have:U.S. CitizenshipPossession of and the ability to maintain a Department of Defense (DoD) Secret Level Security Clearance.3-5 years' experience supporting data engineering efforts and initiativesExperience with containerization technologies (Docker, Kubernetes) is highly valuedExperience with helm charts and deploying managing and scaling applicationsWorking knowledge of Agile methodology and DevOps practicesExperience with open-source, distributed event streaming platform used to collect, process, store, and analyze data feeds (Apache Kafka)Experience with data orchestration tools (Apache Nifi)Experience with open-source monitoring and observability architectures to include Grafana LGTM+ Stack and Elastic (ELK) StackExperience with high-performance, open-source networking infrastructure tools (Nginx, Apache APISIX)Experience with open-source, distributed event streaming platform used to collect, process, store, and analyze data feeds (Apache Kafka, Debezium)Experience with data orchestration tools (Apache Nifi)Experience with open-source data storage and caching services (Postgres, Redis, MinIO)Strong documentation and communication skills to work effectively across technical teamsCollaborative mindset with ability to work in fast-paced environmentsSelf-motivated with strong problem-solving skills and attention to detailAbility to manage multiple projects and priorities simultaneouslyBachelor's degree preferred or equivalent experienceWe'd be Impressed if You Had:Bachelor's degree in Computer Science, Engineering, or related field5+ years' experience in data engineering rolesExperience with CI/CD tools (Jenkins, GitLab CI, Azure DevOps, GitHub Actions)Proficiency with version control systems and collaborative development toolsExperience with configuration management and automation platforms (Ansible, Chef, Puppet)Programming/scripting experience (Python, PowerShell, Bash, Go)Experience with data engineering design and visualization tools (Swagger)Knowledge of microservices architecture and serverless computingAtlas Tech is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity, national origin, disability, genetic information, or protected veteran status.
We are committed to fostering an inclusive workplace where diverse perspectives are valued and respected. Accessibility & AccommodationsAtlas Tech strives to make our website, accessible to all users. If you need assistance completing the application process or require a reasonable accommodation due to a disability, please contact us at This contact information is designated for accommodation requests only and cannot be used to inquire about the status of an application.
Atlas Tech is committed to providing reasonable accommodations in accordance with the Americans with Disabilities Act (ADA).Atlas Tech offers a competitive salary, generous benefits package, and an opportunity to make a positive impact in your own community.