Job description
Role Summary
We are looking for an experienced Lead Confluent Kafka Engineer to support the deployment, configuration, administration, and production operations of Apache Kafka / Confluent Platform. The role requires strong hands-on expertise in Kafka, Java, Spring Boot, Linux, security, troubleshooting, and data streaming, with responsibility for maintaining reliable, secure, and highly available Kafka environments.
Lead Confluent Kafka Engineer
Apache Kafka / Confluent Platform
Kafka, Java, Spring Boot, Linux, security, troubleshooting, and data streaming
Position Details
Job Title: Lead Confluent Kafka Engineer
Job Title:
Employment Type: Full-Time
Employment Type:
Work Arrangement: Onsite
Work Arrangement:
Location: Islamabad
Location:
Experience Required: 5 to 10 years
Experience Required:
Education: Minimum Bachelor’s degree in a relevant field
Education:
Responsibilities
Deploy, configure, and maintain Apache Kafka / Confluent Platform across development, UAT, and production environments.
Apache Kafka / Confluent Platform
Support Kafka cluster provisioning, broker configuration, topic creation, partitioning, replication, retention, and capacity management.
Kafka cluster provisioning, broker configuration, topic creation, partitioning, replication, retention, and capacity management
Perform Kafka upgrades, patches, rolling restarts, configuration changes, and cluster expansion with minimal production impact.
Kafka upgrades, patches, rolling restarts, configuration changes, and cluster expansion
Support deployment of Kafka components such as Schema Registry, Kafka Connect, Control Center, and supporting services.
Schema Registry, Kafka Connect, Control Center, and supporting services
Troubleshoot production issues involving brokers, partitions, ISR, replication, consumer lag, throughput, latency, storage, and connectivity.
brokers, partitions, ISR, replication, consumer lag, throughput, latency, storage, and connectivity
Manage Kafka security configuration, including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores
Support Java/Spring Boot Kafka application deployments, including producer/consumer configuration and integration troubleshooting.
Java/Spring Boot Kafka application deployments
Work with application, DevOps, infrastructure, and security teams to onboard new Kafka use cases and promote changes across environments.
onboard new Kafka use cases and promote changes across environments
Support CI/CD pipelines, deployment automation, configuration management, and release activities for Kafka and Kafka-based applications.
CI/CD pipelines, deployment automation, configuration management, and release activities
Perform health checks, capacity planning, performance tuning, incident management, and root-cause analysis.
health checks, capacity planning, performance tuning, incident management, and root-cause analysis
Maintain operational documentation, deployment procedures, configuration standards, and recovery/runbook documentation.
operational documentation, deployment procedures, configuration standards, and recovery/runbook documentation
Support high availability, disaster recovery, backup/restore, and multi-cluster replication requirements where applicable.
high availability, disaster recovery, backup/restore, and multi-cluster replication
Must-Have Skills
Strong hands-on experience with Apache Kafka / Confluent Platform in production.
Apache Kafka / Confluent Platform in production
Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics.
Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics
Hands-on experience with Kafka deployment, configuration, upgrades, patching, and operational maintenance.
Kafka deployment, configuration, upgrades, patching, and operational maintenance