Kafka Engineer

Overview

The Kafka Engineer / Administrator / Developer is a key member of the program technical team, supporting large-scale data streaming, system integration, and platform modernization initiatives. This role is responsible for designing, developing, administering, and optimizing Apache Kafka clusters and event-driven architectures that support high-volume, mission-critical data flows. The Kafka Engineer works closely with Federal Government stakeholders, architects, developers, DevOps teams, API Gateway (APIGW) teams, and backend system owners to ensure reliable, secure, and scalable event streaming pipelines. This role plays a critical part in enabling real-time data integration, microservices communication, and operational resilience across complex enterprise systems.

Key Functions

Kafka Engineering & Administration

• Design, build, administer, and maintain Kafka clusters across development, test, and production environments.

• Manage Kafka topics, partitions, brokers, replication, retention policies, and access controls.

• Monitor Kafka performance, availability, throughput, and latency; proactively identify and resolve issues.

• Perform capacity planning, tuning, upgrades, patching, and disaster recovery planning for Kafka environments.

• Implement and maintain high availability and fault-tolerant Kafka configurations.

Event Streaming & Integration

• Develop and support event streaming pipelines using Kafka for real-time and near-real-time data processing.

• Integrate Kafka with API Gateway (APIGW)–based microservices and downstream backend systems.

• Design and implement Kafka producers, consumers, and connectors (e.g., Kafka Connect) to support system integrations and ETL/data movement needs.

• Collaborate with application teams to define event schemas, topics, and data contracts.

• Ensure reliable message delivery, data integrity, and error handling across streaming workflows.

Security, Compliance & Operations

• Implement Kafka security best practices, including authentication, authorization, encryption in transit, and auditing.

• Ensure Kafka implementations comply with CMS security, data governance, and operational standards.

• Support DevSecOps practices, CI/CD pipelines, and infrastructure-as-code approaches where applicable.

• Participate in incident response, root cause analysis, and operational readiness activities.

Collaboration & Documentation

• Work closely with architects, developers, DevOps engineers, and system administrators to support solution design and delivery.

• Document Kafka architectures, configurations, operational procedures, and integration patterns.

• Provide technical guidance, troubleshooting support, and knowledge transfer to internal teams.

Minimum Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.

• 3+ years of experience developing, administering, and supporting Apache Kafka in enterprise environments.

• Hands-on experience managing Kafka clusters, topics, partitions, and event streaming pipelines.

• Experience integrating Kafka with microservices, API Gateways (APIGW), and backend systems.

• Strong understanding of event-driven architectures, messaging patterns, and data streaming concepts.

• Experience with Linux-based environments and command-line administration.

• Strong troubleshooting and performance tuning skills.

• Ability to clearly communicate technical concepts to both technical and non-technical stakeholders.

Preferred Qualifications

• Experience supporting federal healthcare programs.

• Experience working in Agile, Scrum, and/or DevSecOps environments.

• Familiarity with cloud-based Kafka deployments (AWS MSK or similar managed Kafka services).

• Experience with CI/CD pipelines and automation tools.

• Knowledge of cloud security concepts and secure data transmission.

• Experience with monitoring tools and observability platforms for Kafka (e.g., Prometheus, Grafana, CloudWatch).

• Familiarity with schema management tools (e.g., Schema Registry).

• Knowledge of containerized environments and orchestration tools (Docker, Kubernetes) is a plus.

How We’ll Support You:

Keeping people satisfied is no small undertaking. At CADRE, our commitment to supporting employees extends further than conventional benefits. While we offer competitive industry-standard packages, our focus goes beyond transactional care.

This is why we developed the CADRE Cares Program which encompasses a range of benefits and initiatives aimed at enhancing the overall well-being and job satisfaction of employees.

We want to support our employees at the times they need it the most. We envision unwavering commitment to our employees that sets a new standard for compassionate and impactful business practices.

• CADRE Convoy Program: A dedicated support system designed to cater to your individual needs and enhance your overall well-being, no matter where you are.

• CADRE Connect Program: A series of intentional touchpoints, events, and initiatives that promote open communication, and encourages continuous growth and development among its team members.

• CADRE Compensation Program:

• 401k Safe Harbor Plans with matching & immediate vesting

• Medical, Dental, & Vision Plans

• Paid Time Off: Holidays, Vacation, Wellness, & Personal Leave Plans

• Continuing Education & Training Budget

• Office & Technology Budget

• Cell Phone Budget

• Wellness & Healthy Living Budget

• Awards & Bonuses

• Profit Sharing Plans

Who We Are:

We’re more than a government contracting company. We’re a cadre, a specialized team finely honed in providing innovative solutions that meet the complex and evolving needs of government agencies. We strategically mobilize, manage, and maintain specialized cadres using our RO(M³) model.

CADRE GOVERNMENT SOLUTIONS is an Equal Opportunity and Affirmative Action Employer. We welcome and encourage diversity in our workforce.

It is the policy of CADRE GOVERNMENT SOLUTIONS to provide equal employment opportunity to all employees and qualified applicants without regard to race, color, religion, national origin, sex, age, disability, pregnancy, sexual orientation, gender identity, genetic information, protected veteran status, or any other protected characteristic under federal, state, or local law.