Mandatory Certificate any Databricks Certified Developer Apache Spark 3 0 Skills Expertise in Data Engineering Hands on experience in design and development of big data platform Deep understanding of modern data processing technology stacks Spark HBase Hive and other Hadoop ecosystem technologies Development using Scala Deep understanding of streaming data architectures and technologies for real time and low latency data processing Experience with agile development methods including core values guiding principles and key agile practices Understanding of the theory and application of Continuous Integration Delivery Experience with NoSQL technologies including column family graph document and key value data storage technologies is a plus Passion for software craftsmanship Experience in Financial Industry is a plus