Job Description: Lead Confluent Kafka Engineer

Career PageIslamabad
ActiveVerified 1h ago

Job description

Role Summary

We are looking for an experienced Lead Confluent Kafka Engineer to support the deployment, configuration, administration, and production operations of Apache Kafka / Confluent Platform. The role requires strong hands-on expertise in Kafka, Java, Spring Boot, Linux, security, troubleshooting, and data streaming, with responsibility for maintaining reliable, secure, and highly available Kafka environments.

Lead Confluent Kafka Engineer

Apache Kafka / Confluent Platform

Kafka, Java, Spring Boot, Linux, security, troubleshooting, and data streaming

Position Details

Job Title: Lead Confluent Kafka Engineer

Job Title:

Employment Type: Full-Time

Employment Type:

Work Arrangement: Onsite

Work Arrangement:

Location: Islamabad

Location:

Experience Required: 5 to 10 years

Experience Required:

Education: Minimum Bachelor’s degree in a relevant field

Education:

Responsibilities

Deploy, configure, and maintain Apache Kafka / Confluent Platform across development, UAT, and production environments.

Apache Kafka / Confluent Platform

Support Kafka cluster provisioning, broker configuration, topic creation, partitioning, replication, retention, and capacity management.

Kafka cluster provisioning, broker configuration, topic creation, partitioning, replication, retention, and capacity management

Perform Kafka upgrades, patches, rolling restarts, configuration changes, and cluster expansion with minimal production impact.

Kafka upgrades, patches, rolling restarts, configuration changes, and cluster expansion

Support deployment of Kafka components such as Schema Registry, Kafka Connect, Control Center, and supporting services.

Schema Registry, Kafka Connect, Control Center, and supporting services

Troubleshoot production issues involving brokers, partitions, ISR, replication, consumer lag, throughput, latency, storage, and connectivity.

brokers, partitions, ISR, replication, consumer lag, throughput, latency, storage, and connectivity

Manage Kafka security configuration, including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.

TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores

Support Java/Spring Boot Kafka application deployments, including producer/consumer configuration and integration troubleshooting.

Java/Spring Boot Kafka application deployments

Work with application, DevOps, infrastructure, and security teams to onboard new Kafka use cases and promote changes across environments.

onboard new Kafka use cases and promote changes across environments

Support CI/CD pipelines, deployment automation, configuration management, and release activities for Kafka and Kafka-based applications.

CI/CD pipelines, deployment automation, configuration management, and release activities

Perform health checks, capacity planning, performance tuning, incident management, and root-cause analysis.

health checks, capacity planning, performance tuning, incident management, and root-cause analysis

Maintain operational documentation, deployment procedures, configuration standards, and recovery/runbook documentation.

operational documentation, deployment procedures, configuration standards, and recovery/runbook documentation

Support high availability, disaster recovery, backup/restore, and multi-cluster replication requirements where applicable.

high availability, disaster recovery, backup/restore, and multi-cluster replication

Must-Have Skills

Strong hands-on experience with Apache Kafka / Confluent Platform in production.

Apache Kafka / Confluent Platform in production

Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics.

Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics

Hands-on experience with Kafka deployment, configuration, upgrades, patching, and operational maintenance.

Kafka deployment, configuration, upgrades, patching, and operational maintenance

Similar jobs