![](https://cdn.nolocation.io/companies/1705921230951471066.png)
Position: Hadoop ExpertLocation: REMOTEEmployment Type: CONTRACT FOR 50 DAYS
Key Responsibilities:Hadoop Administration:Install, configure, and manage Hadoop clusters.Monitor cluster health and performance.Implement and manage security policies for Hadoop clusters.Ensure high availability and scalability of Hadoop clusters.HDFS Management:Perform HDFS maintenance operations such as balancing and upgrades.Manage HDFS storage policies and quotas.Troubleshoot HDFS issues and perform necessary recovery operations.HIVE Management:Set up and optimize HIVE environments.Develop and maintain HIVE scripts for data processing.Implement HIVE security and compliance policies.Optimize HIVE queries for performance and resource utilization.Spark Development:Design and implement Spark applications for data processing and analytics.Optimize Spark jobs for performance and resource efficiency.Integrate Spark with Hadoop and HIVE for seamless data processing.Data Management:Collaborate with data engineers and data scientists to design and implement data workflows.Ensure data quality, integrity, and governance.Develop and maintain ETL processes for data ingestion and transformation.Technical Support:Provide technical support for Hadoop, HDFS, HIVE, and Spark environments.Resolve performance issues and optimize resource usage.Document configurations, procedures, and best practices.Qualifications:Bachelor’s degree in Computer Science, Information Technology, or a related field.5+ years of experience with Hadoop, HDFS, HIVE, and Spark.Proficiency in programming languages such as Java, Scala, or Python.Strong understanding of distributed systems and big data architectures.Experience with Linux/Unix systems administration.Familiarity with cloud platforms such as AWS, Azure, or Google Cloud is a plus.Excellent problem-solving skills and attention to detail.Strong communication and collaboration skills.
Key Skills
Related Jobs
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Security Engineer Ubuntu
![LimeSurvey](https://cdn.nolocation.io/companies/1660423335339479365.png)
Senior Software Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Test Automation Engineer
![Plenty of Fish](https://cdn.nolocation.io/companies/1661544872112376170.png)
Senior Android Engineer
![LeadSimple](https://cdn.nolocation.io/companies/1661544812266350309.png)
Lead Software Engineer
![Iterative](https://cdn.nolocation.io/companies/1660423210424072051.png)
Senior Frontend Engineer
![Wander](https://cdn.nolocation.io/companies/1660231993025589187.png)
Data Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Production Engineer
![Commit](https://cdn.nolocation.io/companies/1660155122581611122.png)
Senior Back End Developer
![AON3D](https://cdn.nolocation.io/companies/1662069060345636558.png)
Senior Frontend Engineer Platform
![Philo](https://cdn.nolocation.io/companies/1660474887673216995.png)
IT Engineer
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Senior Software Engineer Cloud Images
![Levity AI](https://cdn.nolocation.io/companies/1660642670139425624.png)
Senior Product Designer
![Clevertech](https://cdn.nolocation.io/companies/1660147397267007086.png)
Hands On Engineering Manager
![SOCi](https://cdn.nolocation.io/companies/1661544362311902003.png)
Full Stack Software Engineer
![Zuplo](https://cdn.nolocation.io/companies/1663248605340975309.png)
Senior Front End Developer
![Tettra](https://cdn.nolocation.io/companies/1660719903484302286.png)
Customer Success Manager
![Angi](https://cdn.nolocation.io/companies/1659875416164910470.png)
Senior Software Engineer .NET Core
![Ethereum](https://cdn.nolocation.io/companies/1661544528551725780.png)
Front End TypeScript Developer
![Toptal](https://cdn.nolocation.io/companies/1660146888834119919.png)