Senior Spark & Scala Developer [30 days NP max]

Project Description:Data platform delivers regulatory reporting , supports analytical applications and data warehouse needs, i.e., product analytics. Data Platform is currently implemented on top of Cloudera CDP Hadoop, and we need to migrate to BigQuery and Data Proc serverless.

Responsibilities:• Hands on Spark/Scala programming experience• Participating in agile development projects for batch data ingestion.• Fast learner into order to understand the current data landscape and existing Scala/Spark program to make enhancement.

Mandatory Skills:Overall, 5+ years of development experience2–6 years of experience in Scala & Spark• Spark• Scala programming• SQL• Good in writing Hive HQL's• Python or Java experience

Nice-to-Have Skills:Cloud and ETL experience is a plus

Languages:English: C1 Advanced

Key Skills

• Python
• SQL