Senior Spark & Scala Developer

Project description:Data platform delivers regulatory reporting , supports analytical applications and data warehouse needs, i.e., product analytics. Data Platform is currently implemented on top of Cloudera CDP Hadoop, and we need to migrate to BigQuery and Data Proc serverless.

Responsibilities:Hands on Spark/Scala programming experience.Participating in agile development projects for batch data ingestion.Fast learner into order to understand the current data landscape and existing Scala/Spark program to make enhancement.

SkillsMust have:Overall, 5+ years of development experience 2–6 years of experience in Scala & SparkSparkScala programmingSQLGood in writing Hive HQL'sPython or Java experience

Nice to have:Cloud and ETL experience is a plus

Languages:English: C1 Advanced

Seniority Level:Senior

Key Skills

• Python
• SQL
• Kafka