Software Engineer III

About the role

Reflexive Concepts is seeking a skilled Software Engineer III to join our team!

In this role, the engineer will leverage extensive expertise in dataflow design, data transport mechanisms, and Apache Spark-based distributed processing to design, implement, and optimize data ingress/egress pathways, ensuring efficient, scalable, and reliable processing of the organization's analytics workloads.

Qualifications

Active TS/SCI + FS Polygraph

Master's degree in Computer Science or related discipline from an accredited college or university, plus 5 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR

Bachelor's degree in Computer Science or related discipline from an accredited college or university, plus 7 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR

9 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.

Required Skills + Experience:

Experience using the Linux CLI and Linux tools

Experience developing Bash scripts to automate manual processes

Recent software development experience using Python and Java

Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows

Experience with Distributed Big Data processing engines including Apache Spark

Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets

Experience using Jupyter Notebook

Experience with data wrangling and preprocessing using tools such as pandas, NumPy

Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML

Familiarity with data quality concepts, data validation, and anomaly detection

Experience with Git Source Control System

Desired Skills + Experience

Familiar with HPC Job Scheduling tools including Slurm

Experience using the Atlassian Tool Suite (JIRA, Confluence)