Spark Scala & Java DeveloperShift- Malaysian / EURExp- 5+ yrs (2 Positions), 9- 11 yrs (2 Positions)
Full time Contract OpportunityFully Remote
please share resume at Khalil@weradioactive.com
Responsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelines
Skills-Scala (with a focus on the functional programming paradigm)Scalatest, JUnit, Mockito, Embedded CassandraApache Spark 2.xApache Spark RDD APIApache Spark SQL Data Frame APIApache Spark MLlib APIApache Spark GraphX APIApache Spark Streaming APISpark query tuning and performance optimizationData Modelling, Data Warehousing, Hadoop, Hive, ETL, JavaSQL database integration ,Microsoft, Oracle, Postgres, and/or MySQLExperience working with HDFS, S3, Cassandra, and/or DynamoDBDeep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)
Related Jobs
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Security Engineer Ubuntu
![LimeSurvey](https://cdn.nolocation.io/companies/1660423335339479365.png)
Senior Software Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Test Automation Engineer
![Plenty of Fish](https://cdn.nolocation.io/companies/1661544872112376170.png)
Senior Android Engineer
![LeadSimple](https://cdn.nolocation.io/companies/1661544812266350309.png)
Lead Software Engineer
![Iterative](https://cdn.nolocation.io/companies/1660423210424072051.png)
Senior Frontend Engineer
![Wander](https://cdn.nolocation.io/companies/1660231993025589187.png)
Data Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Production Engineer
![Commit](https://cdn.nolocation.io/companies/1660155122581611122.png)
Senior Back End Developer
![AON3D](https://cdn.nolocation.io/companies/1662069060345636558.png)
Senior Frontend Engineer Platform
![Philo](https://cdn.nolocation.io/companies/1660474887673216995.png)
IT Engineer
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Senior Software Engineer Cloud Images
![Levity AI](https://cdn.nolocation.io/companies/1660642670139425624.png)
Senior Product Designer
![Clevertech](https://cdn.nolocation.io/companies/1660147397267007086.png)
Hands On Engineering Manager
![SOCi](https://cdn.nolocation.io/companies/1661544362311902003.png)
Full Stack Software Engineer
![Zuplo](https://cdn.nolocation.io/companies/1663248605340975309.png)
Senior Front End Developer
![Tettra](https://cdn.nolocation.io/companies/1660719903484302286.png)
Customer Success Manager
![Angi](https://cdn.nolocation.io/companies/1659875416164910470.png)
Senior Software Engineer .NET Core
![Ethereum](https://cdn.nolocation.io/companies/1661544528551725780.png)
Front End TypeScript Developer
![Toptal](https://cdn.nolocation.io/companies/1660146888834119919.png)