Experience in building Spark Streaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.
Related Jobs
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Security Engineer Ubuntu
![LimeSurvey](https://cdn.nolocation.io/companies/1660423335339479365.png)
Senior Software Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Test Automation Engineer
![Plenty of Fish](https://cdn.nolocation.io/companies/1661544872112376170.png)
Senior Android Engineer
![LeadSimple](https://cdn.nolocation.io/companies/1661544812266350309.png)
Lead Software Engineer
![Iterative](https://cdn.nolocation.io/companies/1660423210424072051.png)
Senior Frontend Engineer
![Wander](https://cdn.nolocation.io/companies/1660231993025589187.png)
Data Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Production Engineer
![Commit](https://cdn.nolocation.io/companies/1660155122581611122.png)
Senior Back End Developer
![AON3D](https://cdn.nolocation.io/companies/1662069060345636558.png)
Senior Frontend Engineer Platform
![Philo](https://cdn.nolocation.io/companies/1660474887673216995.png)
IT Engineer
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Senior Software Engineer Cloud Images
![Levity AI](https://cdn.nolocation.io/companies/1660642670139425624.png)
Senior Product Designer
![Clevertech](https://cdn.nolocation.io/companies/1660147397267007086.png)
Hands On Engineering Manager
![SOCi](https://cdn.nolocation.io/companies/1661544362311902003.png)
Full Stack Software Engineer
![Zuplo](https://cdn.nolocation.io/companies/1663248605340975309.png)
Senior Front End Developer
![Tettra](https://cdn.nolocation.io/companies/1660719903484302286.png)
Customer Success Manager
![Angi](https://cdn.nolocation.io/companies/1659875416164910470.png)
Senior Software Engineer .NET Core
![Ethereum](https://cdn.nolocation.io/companies/1661544528551725780.png)
Front End TypeScript Developer
![Toptal](https://cdn.nolocation.io/companies/1660146888834119919.png)