Software Engineer III

In this role, the engineer will leverage extensive expertise in dataflow design, data transport mechanisms, and Apache Spark-based distributed processing to design, implement, and optimize data ingress/egress pathways, ensuring efficient, scalable, and reliable processing of the organization's analytics workloads.

Qualifications

• Active TS/SCI + FS Polygraph
• Master's degree in Computer Science or related discipline from an accredited college or university, plus 5 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR
• Bachelor's degree in Computer Science or related discipline from an accredited college or university, plus 7 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR
• 9 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.

• Experience using the Linux CLI and Linux tools
• Experience developing Bash scripts to automate manual processes
• Recent software development experience using Python and Java
• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• Experience with Distributed Big Data processing engines including Apache Spark
• Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
• Experience using Jupyter Notebook
• Experience with data wrangling and preprocessing using tools such as pandas, NumPy
• Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
• Familiarity with data quality concepts, data validation, and anomaly detection
• Experience with Git Source Control System

• Familiar with HPC Job Scheduling tools including Slurm
• Experience using the Atlassian Tool Suite (JIRA, Confluence)