BOAB Ventures
Linkedin · Posted 7d ago
Forward Deployed Data Engineer with Security Clearance
Continue to application
Add your email once, then Caio opens the original posting.
Indexed description
Job Description We're seeking a skilled Forward Deployed Data Engineer to help build next-generation data management and artificial intelligence platforms supporting maritime domain awareness missions. As a forward-deployed engineer, you'll work directly with customers-writing code, integrating systems, and solving complex technical challenges in operational environments. You'll serve as both an engineer and technical advisor, taking ownership of mission outcomes. This position requires a current or active U.S. Secret clearance. This role offers the opportunity to work on real-world projects involving sensor systems, edge data collection, and large-scale maritime data processing environments that directly support operational mission success. Responsibilities
- Implement real-time data pipelines using MQTT and Redpanda for stream processing.
- Implement offline data pipelines using Dagster for batch processing.
- Parse and process binary message formats from various data sources.
- Build data warehouses using PostgreSQL, Apache Iceberg, Parquet, and S3.
- Design data models that support high-performance analytical queries.
- Validate and normalize diverse data sources.
- Improve local development environments and CI/CD workflows using modern tooling and GitHub Actions. Required Skills Required Skills
- Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.)
- Proficiency in Python and Rust for data engineering workflows
- Experience with binary message parsing
- Experience with row-based and columnar data formats
- Experience with OLTP and OLAP databases
- Knowledge of distributed systems, streaming architectures, and batch processing patterns
- Hands-on experience with workflow orchestration platforms such as Dagster or Airflow
- Hands-on experience with streaming platforms such as Redpanda or Kafka
- Experience working with binary message formats such as Protobuf Desired Skills Required Skills
- Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.)
- Proficiency in Python and Rust for data engineering workflows
- Experience with binary message parsing
- Experience with row-based and columnar data formats
- Experience with OLTP and OLAP databases
- Knowledge of distributed systems, streaming architectures, and batch processing patterns
- Hands-on experience with workflow orchestration platforms such as Dagster or Airflow
- Hands-on experience with streaming platforms such as Redpanda or Kafka
- Experience working with binary message formats such as Protobuf
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search
Want help applying to roles like this?
Search Caio for free. If CV tailoring and application tracking get heavy, Full Caio Agent adds a human specialist.
View Full Agent