- Salary
- $3 – $18/yr
- Location
- Hyderabad, Telengana, India
- Workplace
- Hybrid
- Type
- Full-time
- Department
- Engineering
Description
Role: Kafka to AWS MSK Migration Engineer Experience: 5+ yearsLocation: Bengaluru, HyderabadRoles and Responsibilities:Technical CompetenciesCandidates are not expected to be experts in every tool, but should bring strong hands-on experience across several of the following areas:▪ AWS Services: Hands-on experience with AWS compute and migration patterns, including ECS, EKS, Lambda, CloudWatch, and related cloud services.▪ Apache Kafka: Deep hands-on experience with Kafka architecture including brokers, topics, partitions, consumer groups, replication, and cluster operations.▪ AWS MSK: Practical experience with Amazon Managed Streaming for Apache Kafka including cluster provisioning, configuration, monitoring, and security (IAM, mTLS, SASL/SCRAM).▪ Migration Tooling: Experience with MirrorMaker 2, Confluent Replicator, or similar cross-cluster replication tools for data migration and offset synchronization.▪ Cloud Migration: Practical understanding of on-prem to cloud migration strategies, workload assessment, testing, cutover, and post-migration validation.▪ Kafka Ecosystem: Familiarity with Schema Registry, Kafka Connect, Kafka Streams, and related ecosystem components.▪ Networking and Security: Understanding of VPC peering, PrivateLink, TLS encryption, IAM policies, and network connectivity patterns for hybrid Kafka architectures.▪ Programming and Automation: Experience with Python OR Java, Shell, or similar languages to build scripts, utilities, and automation frameworks for topic creation, ACL migration, and consumer group management.Work experience CI/CD pipelines, Jenkins , Docker, Kuberneties▪ APIs and Integration: Working knowledge of RESTful APIs, API design, and API Gateway patterns.▪ CI/CD and Version Control: Strong experience with GitLab, Jenkins, Maven, or similar tools supporting automated build, test, and deployment pipelines.▪ Observability: Familiarity with monitoring, logging, alerting, and troubleshooting using tools such as CloudWatch, Prometheus, Grafana, Splunk, or equivalent platforms for Kafka/MSK cluster health.▪ Automation Excellence: Ability to design repeatable automation and apply AI-assisted engineering approaches to improve migration scale, quality, and efficiency.
