Senior Big Data Software Engineer

We are seeking a highly skilled Senior Big Data Software Engineer / Subject Matter Expert (SME) with extensive experience in HPCC Systems and Enterprise Control Language (ECL) to support the design, development, and optimization of large-scale data processing and analytics solutions. The ideal candidate will have a minimum of five (5) years of hands-on ECL development experience and a strong background in distributed computing, data modeling, and parallel data processing within clustered computing environments.

The successful candidate will design and implement scalable data solutions, develop advanced analytics methodologies, and support mission-critical data processing using HPCC Systems. This role requires expertise in big data technologies, data architecture, and high-performance computing, along with proficiency in one or more programming languages such as Python, R, Pig, Java, C, or SQL.

• Design, develop, and maintain scalable applications using Enterprise Control Language (ECL) within the HPCC Systems platform.
• Develop, optimize, and support large-scale distributed data processing solutions in clustered computing environments.
• Design and implement logical and physical data models to support enterprise analytics and reporting requirements.
• Develop methodologies for collecting, processing, validating, and analyzing large datasets across distributed computing platforms.
• Build, optimize, and maintain high-performance ETL and data transformation workflows.
• Utilize HPCC Systems to perform large-scale parallel processing of structured and unstructured data.
• Develop scalable data integration and data quality solutions supporting enterprise data initiatives.
• Analyze business and mission requirements and translate them into efficient technical solutions.
• Optimize data processing performance through query tuning, workflow optimization, and resource management.
• Collaborate with data scientists, software engineers, system architects, and business stakeholders to deliver enterprise data solutions.
• Develop automated testing strategies and validate data processing methodologies.
• Document technical designs, data models, workflows, and system architectures.
• Troubleshoot complex production issues and provide technical support for HPCC-based applications.
• Participate in Agile software development activities including sprint planning, daily stand-ups, code reviews, testing, and release planning.

• Minimum 5 years of hands-on experience developing applications using Enterprise Control Language (ECL) .
• Minimum 5 years of experience working with HPCC Systems .
• Experience designing and implementing enterprise data models.
• Strong experience performing large-scale parallel data processing.
• Experience developing data processing methodologies within clustered computing environments.
• Proficiency in one or more of the following programming languages:
  • Python
  • R
  • Pig
  • Java
  • C/C++
  • SQL
• Experience with distributed computing and big data technologies.
• Strong understanding of ETL development, data integration, and data transformation techniques.
• Experience optimizing performance for high-volume data processing applications.
• Experience working throughout the full Software Development Life Cycle (SDLC).
• Experience using Agile software development methodologies.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent written and verbal communication skills.

• Experience designing enterprise data architectures.
• Knowledge of distributed database technologies and data warehousing concepts.
• Experience supporting Artificial Intelligence (AI), Machine Learning (ML), or advanced analytics initiatives.
• Experience developing predictive analytics or statistical modeling solutions.
• Experience with cloud computing platforms such as AWS or Microsoft Azure.
• Familiarity with Git, Jenkins, CI/CD pipelines, and DevOps practices.
• Experience working within Intelligence Community (IC), Department of Defense (DoD), or other Federal Government environments.
• Experience mentoring junior engineers and providing technical leadership.

• HPCC Systems
• Enterprise Control Language (ECL)
• Data Modeling
• Distributed Computing
• Clustered Computing
• Parallel Processing
• Big Data Analytics
• ETL Development
• Data Integration
• Data Quality
• SQL
• Python
• Java
• R
• Pig
• C/C++
• Performance Optimization
• Agile Development
• Git
• Jenkins
• CI/CD

• Bachelor's degree in Computer Science, Information Systems, Software Engineering, Data Science, Mathematics, or a related technical discipline.
• Master's degree is preferred.

The ideal candidate is a technical leader with deep expertise in HPCC Systems and ECL development , capable of designing and implementing scalable enterprise data solutions. They possess extensive experience with distributed data processing, data modeling, and high-performance computing while working collaboratively within Agile development teams to deliver innovative, mission-critical analytics solutions.