Job Details:Job Title: Azure Databricks Data EngineerContract Duration: 9 months Contract on W2 to start with Job Location: 100% Remote role
Job Description:The Azure Databricks Developer, will be responsible for designing, developing, and maintaining data processing workflows and analytics solutions using Azure DatabricksUse business requirements to drive the design of data solutions/applications and technical architecture. Create technical, functional, and operational documentation for data pipelines and applicationsDevelop and maintain ETL (Extract, Transform, Load) pipelines using Databricks to process and transform large datasets.Build and optimize Apache Spark jobs and clusters on the Databricks platform.Develop and maintain data ingestion processes to acquire data from various sources and systems.
Experience:Scala: 2 years (Required)- Spark is a reasonable substitute, so if someone has 3+ years of spark but no Scala.Databricks: 3 years (Required)Azure: 3 years (Required)Cloud development: 3-5 years (Required)Python: 3 years (Required)