Overview
Software Engineer – Senior I (Databricks Engineer) with Secret clearance is sought to support the migration of mission-critical legacy applications, services, and platforms into a next-generation Medallion Model on Databricks. This role focuses on modernizing enterprise data systems that impact national mission success in a fast-paced, collaborative environment.
Job Details
Location: Dulles, VA
Clearance: Secret (Must be able to obtain TS/SCI and DHS Suitability)
Company: Quantum Science Solutions (QSS)
Position: Software Engineer – Senior I (Databricks Engineer)
Responsibilities
- Support migration of services, applications, and platforms from legacy back-end systems to Databricks.
- Identify optimal migration paths, build detailed plans, and execute migration strategies.
- Migrate legacy pipelines from NiFi to Databricks and perform validation.
- Implement the Medallion Model for all migrated data assets.
- Develop Standard Operating Procedures (SOPs) for integrating data assets into Databricks with a focus on efficiency, instrumentation, and performance.
- Optimize development, testing, monitoring, and security processes for data assets.
- Automate and optimize data ingestion, pipeline orchestration, and management using programming and scripting languages.
- Leverage AWS CloudWatch and related tools to enhance transparency and monitor pipeline performance.
- Ensure team SOPs are documented and communicated effectively.
- Provide technical oversight to ensure correctness, timeliness, and quality of deliverables.
- Communicate effectively with all levels of management and customer stakeholders.
Required Qualifications
- Must be a U.S. Citizen.
- Active Secret clearance, with ability to obtain TS/SCI and DHS Suitability.
- 8+ years of directly relevant software development experience.
- Minimum of 5 years performing data engineering in a cloud environment.
- Hands-on experience with relational, NoSQL, and file-based storage (Databricks, Elastic, Postgres, S3, Athena).
- Strong background in CI/CD pipeline development.
- Working knowledge of Databricks, NiFi, AWS Redshift, and Elasticsearch.
Preferred Skills
- Databricks Workflows, Unity Catalog, Autoloader, Delta Live Tables/Delta Lake, Workspaces/Notebooks, and MLflow.
- Apache Spark expertise.
- Familiarity with AWS Professional certifications (Solutions Architect, Developer, Data Engineer).
- Knowledge of CISA best practices, software supply chain security, and NIST SP 800-218.
- Experience with collaboration tools including MS Teams, Outlook, SharePoint, and Confluence.
- Excellent problem-solving and communication skills.
Education
- Bachelor’s degree in software engineering, Computer Science, or related discipline.
- In lieu of degree, 10 additional years of experience (total of 18+ years) may be substituted.
Benefits
- Competitive compensation with annual performance bonuses
- 401(k) with company match
- Opportunities for continuous learning and skill development
Why QSS?
At QSS, you’re not just filling a role, you’re shaping mission-critical solutions that keep our nation secure. We invest in your growth, foster innovation, and reward technical excellence.
#J-18808-Ljbffr