Data Engineer

Innovien Solutions is hiring an experienced Data Engineer supporting various efforts around their core data and analytics platform. You will be joining a team that securely connects more than 3 million end users at over 3,000 DoD and Federal sites around the world. In this position, you will help lead core data platform engineering – owning the full data pipeline lifecycle from ingestion to delivery, expanding the foundational Integrated Data Architecture platform, and building scalable, optimized data infrastructure in support of mission-critical DoD network operations. *Must sit onsite 2-3x weekly at one of the following locations: Ft. Meade, MD, Scott Air Force Base, IL or Hill Air Force Base, UT.* Apply today to connect with our team for more details!

REQUIREMENTS:
• 7+ years of hands-on end to end data engineering experience – building and optimizing ETL processes and data pipelines
o 3+ years’ experience building pipelines with Elastic/ELK stack (Elasticsearch, Logstash, Kibana)
• Extensive experience utilizing data pipeline messaging or flow platforms such as Apache Kafka/Confluent or Nifi, AWS Kinesis or EventBridge, Azure Event Hubs, RabbitMQ
• Experience with OpenShift or Kubernetes for container orchestration and platform deployment
• Python, Java, and/or SQL programming experience
• Experience working in Agile development environment (SDLC) supporting sprint cycles, testing, and deployment activities
• Active SECRET Clearance or higher REQUIRED
• CompTIA Security+ certification required within the first 14 days of employment
• B.S. Degree

PREFERRED SKILLSET:
• Certified Confluent Developer and/or Certified Elastic Engineer Certifications
• Databricks platform experience
• Experience developing and deploying software in a DoD environment
• Experience with Atlassian tools including JIRA and Confluence

RESPONSIBILITIES:
• Contribute to data engineering efforts by supporting the integration and enrichment of DISN network topology data for advanced data correlation and analytics.
• Participate in technical discussions with internal and external stakeholders to support solution design and implementation.
• Develop, test, and deploy data pipelines and integration solutions across distributed systems and cloud environments, using Python, JavaScript, Java, and SQL.
• Assist in requirements gathering and collaborate with stakeholders to design and implement data enrichment pipelines, integrating diverse data sources into Confluent (Kafka) and Elastic platforms.
• Develop and maintain Kibana visualizations and dashboards to support operational insights.
• Support Kafka system integrations between Elasticsearch/Logstash and other systems.
• Collaborate within Agile scrum teams, contribute to team deliverables, and share knowledge with peers.
• Communicate and coordinate effectively with geographically distributed team members to achieve project objectives.
• Troubleshoot and help resolve installation, infrastructure, and system issues; report and help mitigate technical risks.
• Develop and maintain technical documentation, including DoD requirements, interface documents, and security compliance artifacts.
• Ensure solutions comply with DoD security standards and guidelines, and support platform sustainment and reliability by addressing operational challenges as needed