Kavaliro
Linkedin · Posted 4d ago
Common Data Lake SME
Continue to application
Add your email once, then Caio opens the original posting.
Indexed description
Job DescriptionCore Responsibilities 2.1 Data Source Ingestion & Operationalization
- Approved Source Onboarding: Execute end-to-end ingestion, validation, and testing workflows for approved data sources (commercial feeds; government/classified data when authorized; DICE operational data flows; and ITMN dissemination feeds). Ensure each source is tested from ingestion through normalization, tagging, discovery, and practical availability to operational consumers. Work closely with DICE, J2 leadership and operational stakeholders to understand how approved sources meet operational requirements and integrate with existing workflows.
- Source Validation & Experimentation: Design and conduct field validation experiments on candidate data sources to assess operational relevance, data quality, latency, and integration complexity. Document and present practical assessments to DICE, J2 leadership and stakeholders, providing technical input into source prioritization and roadmap decisions. Collaborate with both J2 and DICE operational teams to understand diverse requirements and integration needs across the enterprise.
- Data Documentation & Operational Readiness: Maintain comprehensive data source documentation, including data provenance, update cadences, quality metrics, and operational employment notes. Ensure operators and decision-makers can discover and understand what data is available, how current it is, and how to employ it operationally.
- Operational Data Quality: Monitor approved data sources to ensure they remain operationally viable—tracking data freshness, accuracy, completeness, and delivery timeliness. Identify issues and escalate to engineering team for resolution, or execute workarounds to maintain operational continuity for DICE, J2 and joint operations consumers.
- End-to-End Flow Validation: Validate data flows between the data lake, Kernos platform, DICE operations, ITMN dissemination network, and other operational systems. Test data movement across classification levels, network segments, and geographic locations. Identify chokepoints, latency, quality issues, and integration failures.
- Integration & Interoperability: Coordinate with platform engineering and operations teams to test data availability and format consistency across dependent systems. Execute integration tests during system updates, new source additions, and operational exercises.
- Network & Dissemination Testing: Work with ITMN network operations to validate that data dissemination flows function reliably to coalition partners, operational and interagency consumers. Test partner-releasable data products (IL2, unclassified) delivery mechanisms and timing.
- Field Exercise & Real-World Validation: Deploy to JELC conferences, planning events, exercises, and integration activities to conduct live testing of data availability, quality, and utility under operational conditions. Document results and feed findings back to engineering team.
- Engagement with J2, J3 and J6: Work closely with SOCPAC J2, J3 and J6 stakeholders to understand actual data usage patterns, operational requirements, and decision-maker needs. Coordinate across multiple operational teams to identify what data is being used effectively, what is not, and why. Represent data operations in planning meetings and synchronization forums.
- Requirements Translation: Translate operational requirements and feedback into practical technical priorities for the engineering team. Serve as the voice that bridges operational employment and platform capability development.
- Continuous Experimentation & Validation: Maintain an ongoing cadence of small-scale proof-of-concept tests, use-case validations, and operational experiments with both J2 and DICE operational teams. Document and share results to validate data value, inform employment strategy, and support rapid iteration on operational concepts.
- DICE Operations Coordination: Coordinate with DICE stakeholders to ensure data flows supporting joint operations are validated, reliable, and meet operational timelines and classification requirements. Support INDOPACOM Mission Network integration as applicable.
- Policy & Regulatory Compliance: Ensure all data ingestion, storage, and dissemination practices comply with applicable DoD directives (e.g., DoDI 5040.02, DoDI 5200.01), data governance policy, and classification/releasability guidance. Maintain documentation supporting audit and compliance reviews.
- Stakeholder Collaboration: Act as a technical liaison to internal users (VIT engineering, operations teams) and external entities (SOCPAC J2, DICE, coalition partners, data providers) to coordinate data integration and troubleshoot operational issues. Participate in daily/weekly synchronization meetings and operational planning teams.
- Minimum of three (3+) years' experience, within the last 10+ years, in military operations or intelligence environment, with demonstrated experience in Special Operations Forces (SOF) or joint operations. Direct experience in data operations, logistics, or communications is valued but not required; proven adaptability and ability to learn in fast-paced operational environments is key.
- Data and systems literacy: Demonstrated understanding of data concepts (ingest, schema, normalization, tagging, lineage, quality assessment). Familiarity with query languages (SQL or equivalent), structured data at scale, and data flow architecture.
- Network and system flow understanding: Comfortable tracing data across networks, systems, and classification levels. Ability to diagnose integration issues and communicate technical problems to both operational and engineering audiences.
- Testing and validation mindset: Experience designing and running practical tests, validating assumptions, documenting results, and presenting findings to stakeholders.
- SOCPAC / PACOM and/or DICE operations background: Comfortable tracing data across networks, systems, and classification levels. Ability to diagnose integration issues and communicate technical problems to both operational and engineering audiences.
Job Requirements
On-Site
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search
Want help applying to roles like this?
Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search