Data Engineer

The Arena

Yesterday
Top Secret/SCI
Early Career (2+ yrs experience)
$150,000 and above
No Traveling
Full Scope Polygraph
IT - Data Science
Reston, VA (On-Site/Office)

Data Engineer
Location: Reston, VA​


About the Role:​
An opportunity with a mission-critical IC Sponsor for a Data Engineer position. The
Sponsor organization plays a significant role in delivering highly optimized, mission-ready data
conditioning and delivery systems supporting mission analytics. A Full-Scope Polygraph is
required — no exceptions.

Responsibilities:

●​ Design and develop complex new software products or significantly enhance existing
software
●​ Build modular, reusable services and features within a modern service-oriented
architecture
●​ Work independently with minimal supervision in an Agile team environment
●​ Deploy and maintain Apache NiFi clusters
●​ Develop ETL (Extract, Transform, Load) processes for mission-critical data systems
●​ Create and maintain Ansible playbooks and roles for software-driven deployment of NiFi
and Zookeeper clusters
●​ Use AWS EC2 instances for infrastructure needs
●​ Develop dashboard visualizations in Kibana based on data from Elasticsearch
●​ Integrate and interact with RESTful services via REST APIs​


Requirements:

●​ Active Full-Scope Polygraph
●​ Expertise with Apache NiFi and equivalent IC technologies
●​ General understanding and ability to work with Zookeeper
●​ Expert-level experience developing ETL processes
●​ 5+ years of experience with scripting languages such as Bash, Python, and Groovy
●​ Experience using AWS EC2 instances
●​ 2-5 years’ experience with Ansible for automated deployments
●​ Familiarity with Git and GitLab
●​ 2-5 years’ experience calling RESTful services using REST APIs
●​ Working knowledge of Linux (especially the Rocky Linux variant)
●​ Familiarity with Elasticsearch and Kibana
group id: 91164143
N
Name HiddenHead of Growth

Match Score

Powered by IntelliSearch™
Create an account or Login to see how closely you match to this job!

Similar Jobs


Job Category
IT - Data Science
Clearance Level
Top Secret/SCI
Employer
The Arena