Dataflow Engineer (Senior)
Constellation Technologies, IncCyber Operations, company
Annapolis Junction, United StatesSenior
Data & AI
About the role
TL;DR
Senior Dataflow Engineer responsible for building and maintaining data pipelines with LLM integration.
- •Constellation Technologies, Inc. is seeking a Senior Dataflow Engineer with a TS/SCI clearance and polygraph.
- •This role involves integrating LLMs, data engineering, and utilizing various tools to build and maintain data pipelines.
- •Key Responsibilities Design, develop, and maintain dataflow pipelines using NiFi.
- •Integrate LLM technologies and RAG frameworks into data solutions.
- •Manage and troubleshoot dataflow systems, including NiFi clusters.
- •Work with relational and vector databases, Elasticsearch, and Kibana.
- •Deploy and manage systems that ingest large volumes of data.
- •Requirements US Citizenship with active TS/SCI clearance and polygraph.
- •Eight (08) years of direct/relevant experience.
- •Bachelor’s degree in computer science or related discipline.
- •Strong experience with NiFi and NiFi cluster management.
- •Proficiency in Python scripting and troubleshooting dataflows.
Required skills
PythonElasticsearchLinuxDockerCI/CDGitJiraConfluence
Nice-to-have skills
KubernetesApache Kafka
Domain expertise
defensegovernment
Tech stack
PythonLLMsGitJiraConfluenceRustCI/CDElasticsearchLinuxDocker