Data Engineer (Op AI)
5 days ago
San Diego
Job DescriptionSalary: $158,000 - $165,000.00 About Us: PMAT is an innovative small business founded with a passion for developing forward-leaning solutions from exceptional people that increase the mission's capability. We focus on designing and building impactful digital solutions that utilize modern cloud, data, and software concepts. Our passion is working on complex and progressive challenges such as edge platform computing, containerizing legacy platforms, distributed data platforms, or heterogeneous data analysis. We recruit, retain, and foster a team motivated to pursue passions, investigate new ways of doing things, and embody an innovative and entrepreneurial spirit. We believe in being curious about every element of a problem and experiment relentlessly. We foster continuous learning in an environment that encourages positive collaboration and expands our capabilities. We tap into collective intelligence, acknowledging that the most brilliant people may not be in the room. Above all else, we believe that delivering and demonstrating is more potent than a sheet of paper. We are passionate about mission-centric design and delivering effective capabilities to and for the warfighter. Whether youre an experienced engineer or just beginning your career, youll work alongside experts who are committed to solving mission-critical problems. If youre passionate about using your skills to make a real difference, apply today and become part of a team thats shaping the future of defense technology! About the Role:PMAT is seeking a Data Engineer to support the design, development, and deployment of high-quality data pipelines and analytics for mission-focused applications. This role integrates data engineering, exploratory data analysis, distributed systems, and cloud-native technologies to deliver performant, reliable, and secure data capabilities. The Data Engineer will collaborate across multidisciplinary teams to ensure high-quality data output, robust testing, and operational readiness in support of DoD missions. Responsibilities: • Conduct data pre-processing, exploratory data analysis, and data pipeline engineering to ensure performant and high-quality data output., • Conduct thorough testing and validation of data pipelines and analytics to ensure accuracy, reliability, and robustness., • Design or normalize data to common standards to support interoperability and analytical workflows., • Develop and deploy data pipelines and analytics in real-world applications., • Work with multiple data formats, including CSV, JSON, XML, Parquet, and ORC., • Perform exploratory data analysis, algorithm development, and testing., • Deploy, monitor, and improve data pipelines for operational environments., • Implement event streaming pipelines using Apache Kafka, RabbitMQ, or ZeroMQ., • Collaborate with analytics, engineering, and mission teams to ensure effective data integration and output quality., • Stay current with emerging trends in data engineering, distributed systems, and modern data architecture., • Document data processes, pipeline structures, and engineering best practices. Required Skills and Experience: • At least 3 years of experience as a business analyst, data analyst, data scientist, data engineer, database administrator, geospatial analyst/engineer, machine learning engineer, or software engineer., • Strong programming skills in Python., • Experience designing or normalizing data to common standards., • Experience with data pipeline development and real-world deployment., • Experience with multiple data formats: CSV, JSON, XML, Parquet, ORC., • Familiarity with event streaming platforms (Kafka, RabbitMQ, ZeroMQ)., • Experience with exploratory data analysis, algorithm development, and testing., • Experience deploying, monitoring, and improving data pipelines., • Strong problem-solving and analytical skills., • Excellent communication skills and ability to work effectively in a collaborative team environment., • Familiarity with data pipeline frameworks and libraries (AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake)., • Experience retrieving and managing GIS data (ArcGIS, PostGIS)., • Programming skills in Go or Rust., • Expertise with Elasticsearch, Redis, S3, PostgreSQL, or similar data stores., • Experience with AWS native data services: EFS, RDS, S3, SNS, SQS., • Experience with distributed computing and parallel processing (AWS Lambda, DASK, Spark)., • Familiarity with cloud platforms (AWS, Azure) and containerization (Docker, Kubernetes)., • Understanding of cybersecurity principles in the context of data applications., • Previous experience with government agencies or military organizations. Preferred Skills and Experience: • Experience with large-scale data architecture across secure DoD or government environments., • Experience supporting NAVWAR, NIWC Pacific, or other Navy programs., • Experience integrating data pipelines into operational mission systems., • Familiarity with ML Ops or data engineering in classified or cross-domain environments. Education and Certification Requirements: • Bachelor of Science in Computer Science, Data Science, Geography, Math, Machine Learning, or Statistics., • Additional certifications in cloud, data engineering, GIS, or cybersecurity are a plus if required by contract. Citizenship and Clearance Requirements: • US Citizenship, • No dual citizenship, • Active DoD TS/SCI clearance required Location: • Arlington, VA; Colorado Springs, CO; Charleston, SC; Denver, CO; or San Diego, CA. Travel: • Up to 15% CONUS (and occasional OCONUS if mission requires). Work Environment: PMAT offices as needed. In some cases, work in a government facility may be required. Travel may be required for customer engagement, team coordination, and mission execution. PMAT is an equal-opportunity employer. We believe in hiring a diverse workforce and sustaining an inclusive, people-first culture. We are committed to non-discrimination on any protected basis, such as disability and veteran status, or any other basis covered under applicable law. #CJ