Kafka Developer - Java/Distributed Systems

Job Description : We are seeking a highly skilled and experienced Kafka Developer to join our team. The ideal candidate will have a strong background in Apache Kafka, Java, and distributed systems, with hands-on experience in building and optimizing Kafka-based applications. The developer will be responsible for creating Kafka producers and consumers, handling streaming data, and ensuring high-performance and reliable Kafka clusters. Key Responsibilities : - Design, develop, and implement Kafka producers and consumers to handle streaming and real-time data processing. - Build Kafka-based applications using Java, Spring Boot, and Microservices architecture. - Develop and configure Kafka Source/Sink Connectors and Kafka REST Proxy for seamless data integration. - Set up and manage Kafka Topics, brokers, and Zookeeper instances. - Monitor and optimize Kafka clusters to ensure high throughput, low latency, and reliability. - Handle event-driven architecture and ensure fault tolerance in real-time data streaming systems. - Tune Kafka Producers/Consumers using configuration parameters to achieve optimal performance. - Troubleshoot and handle exceptions, failure scenarios, and data consistency issues in Kafka applications. - Integrate Kafka with other systems and platforms for data ingestion and streaming pipelines. - Deploy and manage Kafka applications in Kubernetes environments for scalable and containerized solutions. - Provide a basic overview and implementation of KSQL for stream processing. - Stay updated with the latest trends and best practices in distributed systems and real-time data Skills : - Hands-on experience with Apache Kafka and knowledge of its architecture. - Proficient in creating and managing Kafka Producers, Consumers, and Topics. -Experience with Kafka Connect, Source/Sink Connectors, and REST Proxy. - Strong proficiency in Java, Spring Boot, and building Microservices. - Familiarity with distributed systems and streaming data architecture. - Experience in setting up and optimizing Kafka clusters. - Basic understanding of KSQL for stream processing. - Familiarity with message queues, big data processing, and real-time data handling. - Experience with Kubernetes for deploying Kafka applications is a strong plus. - Strong analytical and problem-solving abilities. - Excellent communication skills for interacting with cross-functional teams. - Ability to document configurations, processes, and troubleshooting steps. Preferred Qualifications : - Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. - Experience in big data frameworks like Hadoop or Spark is a bonus. - Knowledge of DevOps tools and CI/CD pipelines for automated Kafka application deployment (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/28/2024