Kafka Administrator

Job description

Must Have Technical/Functional Skills

• Strong understanding of Kafka architecture, concepts, and best practices.
• Proven experience in administering Confluent platform Brokers, Zookeepers, Schema registry, Restproxy, Ksql, Connectors and Control Center, Topics, ACLs etc.,
• Experience in administering and supporting AWS MSK Clusters.
• Experience with Kafka AdminClient for managing topics programmatically.
• Experience with monitoring and alerting tools like Prometheus, Grafana, Alertmanager, Dynatrace etc.,
• Experience with Linux/Unix operating systems.
• Knowledge of software containerization and Kubernetes.
• Experience with scripting languages (Python, Shell).
• Automate installations and deployments using tools like Ansible, gitops, terraform etc.,
• Experience with GitLab pipeline.
• Knowledge of Service-Now, JIRA software. Roles & Responsibilities

Cluster Management

• Install, configure, and maintain Confluent and AWS MSK Kafka clusters. Manage large-scale, multi-node Kafka cluster environments (on-prem and cloud). Troubleshoot and resolve issues related to Kafka brokers, topics, and data flow. Optimize Kafka configurations for performance, scalability, and fault tolerance.

Plan and execute Kafka version upgrades and apply patches. Develop and maintain disaster recovery plans. Create and maintain documentation.

Security

• Implement and manage security protocols.

Performance and Monitoring

• Monitor Kafka clusters to ensure optimal performance and availability. Collect and maintain performance metrics. Fine-tune Kafka configurations based on performance data.

Collaboration

• Provide guidance and support to developers using Kafka.

Automation

• Automate Kafka Cluster installations and topics/acls/connectors deployments using tools like Ansible, terraform, gitops. Develop and maintain automation for Kafka infrastructure.

Salary Range

$90,000 to $115,000 per year

Qualifications

BACHELOR OF COMPUTER SCIENCE