Data Engineer Jobs

Position Overview

PMAT has an immediate need and is seeking an experienced Data Engineer to support a transformational, Navy-led network-centric initiative that converges existing systems, automating the correlation of multiple ISR data streams and dramatically reducing the “sensor-to-shooter” timeline. The candidate must hold a Bachelor’s degree in Data Science, Computer Science, Engineering, or a related STEM field, and possess US Citizenship with an active TS SCI clearance. This role is based at the PMAT office and NAVWAR Old Town Complex in San Diego, CA, with under 10% travel and potential work in a government facility.

Key Responsibilities

• Build and optimize robust data pipelines – including ingestion, transformation, storage, and governance.
• Convert between tactical data formats (e.g., XML, JSON, GEOJSON, Cursor-on-Target (CoT), JREAP-C, Link-16).
• Implement automation using CHRON/CRON jobs and data orchestration frameworks (Apache Airflow, Kafka, AWS Step Functions).
• Architect and maintain scalable data stores (e.g., Apache Iceberg, Elasticsearch) with schema evolution and deduplication.
• Enable real-time data indexing and fast query performance.
• Implement MIL-STD-6016 (Link-16) and MIL-STD-3011 (JREAP) message handling.
• Support integration or development of Cross-Domain Solutions (CDS) for secure, policy-based data transfers.
• Present complex data flows and technical insights effectively to leadership and stakeholders using clear data models and visual aids.

Required Qualifications

• Hands-on coding proficiency in Python (without reliance on modern libraries).
• Experience in format conversions with XML, JREAP-C, Cursor-on-Target (CoT), JSON, GEO JSON, UMF/UHR, text Link-16, Tapil-J, and other tactical data links.
• Expertise in natural language parsing (NLP) and using regular expressions (RegEx).
• Proven experience in implementing CHRON/CRON jobs.
• Experience with data pipeline orchestration, ETL processes, and orchestration tools (e.g., Kafka, Apache Airflow, AWS Step Functions).
• Experience implementing and monitoring data stores (e.g., Apache Iceberg, Elasticsearch) including data lake management.
• Familiarity with schema evolution, dataflow, and governance best practices.
• Experience with real-time search and analytics engines for indexing and querying semi-structured data.
• Proven ability to optimize data store queries for speed and deduplication.
• Direct experience implementing MIL-STD-6016 and MIL-STD-3011 standards.
• Ability to translate data between source and destination schemas and develop clear data models.
• Experience preparing PowerPoint presentations for leadership and stakeholder engagements.
• Experience working with or developing Cross Domain Solutions (CDS) systems.
• Bachelor’s degree in a related field is required.

Preferred Qualifications

• Familiarity with DoD data architecture principles (e.g., DoDAF, CADM).
• Experience with DataOps or similar mission-critical pipeline automation (e.g., deduplication, schema normalization).
• Experience leveraging universal data distribution architectures within DOD operations.