PySpark Developer

We are looking for our client!

Job Title: PySpark DeveloperLocation: RemoteJob Type: Full-TimeExperience: 5 – 7 yearsNotice Period: Immediate Joiner, Currently Serving Notice period

Qualifications and SkillsProficiency in Python (Mandatory skill) with a strong understanding of its libraries and frameworks.Experience with PySpark (Mandatory skill) and working on Big data technologies (Mandatory skill).Strong knowledge of cloud platforms including AWS and Azure, to develop and maintain scalable applications.Proficiency in SQL for querying databases and performing data manipulations.Hands-on experience with Apache Spark to manage large-scale data processing.Familiarity with the Hadoop ecosystem and its components.Capacity to troubleshoot and optimize large-scale distributed data processing jobs.Ability to work effectively in a remote team environment, demonstrating strong communication skills.

Roles and ResponsibilitiesDevelop, test, and maintain scalable data processing applications using PySpark and Big data technologies.Optimize and troubleshoot complex data processing workflows to ensure high performance and reliability.Collaborate with cross-functional teams to design and implement intricate data pipelines.Participate in architectural discussions to ensure the solutions are scalable and performant.Work with cloud platforms like AWS and Azure to deploy and maintain data solutions.Provide ongoing maintenance, support, and enhancements in existing systems and platforms.Document code and processes to enhance maintainability and knowledge sharing.Stay current with the latest industry trends and technologies to bring innovative solutions to the team.

Key Skills

• AWS
• Python
• SQL
• Azure