Senior Data Engineer

Senior Data Engineer

• $180,000 - $200,000
• Apache NiFi / Data Integration / Mission Systems
• Virginia Beach, VA / On-site
• Active TS/SCI Clearance Required

Summary

This team operates the dataflow environment responsible for moving critical information from collection through transformation, routing and delivery to operational users.

You will take ownership of the Apache NiFi environment, shape how the flows are designed and make the technical decisions that determine how reliably and quickly data reaches the people who need it.

Responsibilities

• Design, build and maintain Apache NiFi dataflows
• Own the architecture for data ingestion, transformation, routing and delivery
• Tune flows for performance, reliability and recoverability
• Develop custom processors and controller services where required
• Troubleshoot complex dataflow issues during active operations

Required Experience

• At least three years of hands-on Apache NiFi experience
• Experience designing, tuning and troubleshooting production NiFi dataflows
• Knowledge of clustering, back pressure, provenance, prioritization and failure handling
• Active TS/SCI clearance and a bachelor’s degree in an engineering discipline

We’re Working With

• Apache NiFi and NiFi Registry
• Custom processors and controller services
• Data ingestion, transformation and routing
• Clustering, back pressure and provenance
• Cloudera, Kafka and enterprise data platforms
• Windows, Linux and virtualized infrastructure
• Secure mission systems and operational data environments

TO BE CONSIDERED

Please either apply by clicking online or emailing me directly [email protected]. I can make myself available outside of normal working hours to suit between 7am until 8pm. If unavailable, please leave a message and either myself or one of my colleagues will respond.

By applying for this role, you give express consent for us to process and submit, subject to required skills, your application to our client in conjunction with this vacancy only. Also feel free to follow me on Twitter @searchablejim or connect with me on LinkedIn! I look forward to hearing from you.

APACHE NIFI / NIFI / SENIOR DATA ENGINEER / DATA ENGINEER / DATA INTEGRATION / DATAFLOW / DATA FLOW / DATA PIPELINES / DATA INGESTION / DATA TRANSFORMATION / ETL / CLUSTERING / BACK PRESSURE / DATA PROVENANCE / CONTROLLER SERVICES / CUSTOM PROCESSORS / CLOUDERA / KAFKA / LINUX / WINDOWS / VIRTUALIZATION / MISSION SYSTEMS / SYSTEMS INTEGRATION / TS/SCI / CLEARED ENGINEER / VIRGINIA BEACH