Senior Confluent Cloud Developer

About the company:Scalable Systems is an Equal Opportunity Employer. It is a USA-based Big Data, Analytics and Digital Transformation Company focused on vertical, innovative solutions. By providing next-generation technology solutions and services, we help organizations identify risks & opportunities, achieve operational excellence, and gain an innovative edge.

Responsibilities: Design, develop, and maintain scalable data pipelines using Kafka, KSQL, KStream, and Confluent Cloud; Optimize and tune data processing systems for performance and efficiency; Troubleshoot and resolve data-related issues; Build strong relationships with senior client stakeholders, helping them to understand how they can leverage Big Data Technologies to solve their unique business problems Support the early life definition of projects e.g. shaping definition of scope and input into business cases e.g. *Estimation and Impact Analysis Translate critical requirements into scalable data solutions, being responsible for designing multiple data architectures Guide the full Data Solution project lifecycle - including discovery, requirements analysis, information architecture design, implementation, testing and deployment Take part in Agile delivery team ceremonies, including planning, retrospectives etc. Work with data technology partners/vendors to ensure best fit solutions are delivered to our Clients.

Requirements: JSON, ParQue, Xml.Proven experience as a Data Engineer with expertise in Kafka (Snowflake is a a big plus); Hands-on experience with KSQL, KStream, and Confluent Cloud. Strong programming skills in languages such as Java, Python or Scala; Experience with data modeling, ETL processes, and data warehousing. Familiar with any cloud platforms (AWS or Azure); Experience and understanding of modern data architectures and patterns (e.g. Lambda architecture, Streaming, Data Lake architectures) In-depth experience with no-sql data modelling, database design, and architecture – has designed and developed modern, scalable, maintainable, high-quality databases & data services for large-scale data engineering projects. Strong overall knowledge of application capabilities, integration, data design, methodologies' and industry best practices Customer-centric approach (Customer data domain centric, Able to explain information to stakeholders) – able to explain technical concepts to both technical and non-technical client stakeholders. Comfortable working in an international context, within virtual teams and can interact easily with international stakeholders. Experience of working within an Agile delivery framework (e.g. Scrum, DSDM) Leadership skills; able to take a leading technical role in a data/analytics project Excellent English skills

Key Skills

• AWS
• Agile
• AWS Lambda