Job Description:
As a Kafka Administrator, you will be responsible for the design, implementation, and maintenance of our Kafka ecosystem, ensuring its scalability, reliability, and performance to meet the evolving needs of our organization. You will collaborate closely with data engineers, software developers, and other stakeholders to architect robust solutions and streamline data pipelines.

Your key responsibilities will include:

• Installing, configuring, and managing Apache Kafka clusters, including brokers, ZooKeeper, Kafka Connect, and Kafka Streams, across development, testing, and production environments.
• Monitoring Kafka cluster health, performance metrics, and throughput, and proactively identifying and addressing potential bottlenecks or issues.
• Implementing security measures, access controls, and encryption protocols to safeguard data privacy and integrity within the Kafka ecosystem.
• Managing Kafka topics, partitions, replication, and consumer groups, and optimizing configurations for efficient resource utilization and high availability.
• Collaborating with cross-functional teams to design and implement data ingestion pipelines, Real Time processing workflows, and event-driven architectures.
• Performing capacity planning, scaling, and disaster recovery planning to ensure scalability, fault tolerance, and business continuity.
• Automating routine tasks, such as cluster provisioning, deployment, monitoring, and alerting, using configuration management tools and Scripting languages.
• Staying abreast of industry best practices, emerging trends, and new features in Kafka and related technologies, and evaluating their applicability to our environment.