Roles and Responsibilities
Design, develop, and maintain scalable and reliable Kafka-based data pipelines.Implement and manage ETL processes to handle large volumes of data efficiently.Develop and maintain Java/Spring Boot applications to support various business functions.Integrate Kafka with other data processing frameworks and storage solutions.Collaborate with data analysts, data scientists, and other developers to understand data requirements and deliver robust solutions.Ensure data security, integrity, and governance policies are adhered to in all data engineering processes.Monitor and manage Kafka cluster performance, job execution, and resource utilization. Required Qualifications
8+ years of experience in software development with a strong focus on Kafka, ETL, and Java/Spring Boot.Hands-on experience in the Kafka Messaging system with Topics, Connectors, and Consumer groups.Experience in writing Producer and Consumer programs for the Kafka Messaging system.Hand-on experience with deploying and implementing applications on the OCP platform.Experience with microservices architecture and RESTful API development.Knowledge of data modeling, data architecture, and data governance.Hands-on experience in Mongo DB.