![](https://cdn.nolocation.io/companies/1716415217667273029.png)
Must haves- • Apache Spark: Deep understanding of Spark's core concepts, performance optimization, and the ability to develop efficient data processing jobs. • Databricks data catalog: create tables from S3 and make them available in the unity catalog • Python, and SQL. Knowledge of R is a plus. • Hands-on experience with the Databricks platform, including Databricks SQL, Delta Lake, and Databricks Workspaces. • Experience with AWS and understanding how to integrate them with Databricks. • Version Control: Proficiency in using version control systems, such as Git, for code management and collaboration. Great to haves- • DevOps and CI/CD: Understanding of DevOps principles and experience with CI/CD pipelines to automate testing and deployment of Databricks jobs. • Data Engineering Skills: Experience in designing and implementing scalable and reliable data pipelines, understanding of ETL processes, and familiarity with data modeling techniques. • Machine Learning and Data Science: Knowledge of machine learning algorithms and data science principles. Experience with MLflow for managing the machine learning lifecycle.
Key Skills
Related Jobs
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Security Engineer Ubuntu
![LimeSurvey](https://cdn.nolocation.io/companies/1660423335339479365.png)
Senior Software Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Test Automation Engineer
![Plenty of Fish](https://cdn.nolocation.io/companies/1661544872112376170.png)
Senior Android Engineer
![LeadSimple](https://cdn.nolocation.io/companies/1661544812266350309.png)
Lead Software Engineer
![Iterative](https://cdn.nolocation.io/companies/1660423210424072051.png)
Senior Frontend Engineer
![Wander](https://cdn.nolocation.io/companies/1660231993025589187.png)
Data Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Production Engineer
![Commit](https://cdn.nolocation.io/companies/1660155122581611122.png)
Senior Back End Developer
![AON3D](https://cdn.nolocation.io/companies/1662069060345636558.png)
Senior Frontend Engineer Platform
![Philo](https://cdn.nolocation.io/companies/1660474887673216995.png)
IT Engineer
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Senior Software Engineer Cloud Images
![Levity AI](https://cdn.nolocation.io/companies/1660642670139425624.png)
Senior Product Designer
![Clevertech](https://cdn.nolocation.io/companies/1660147397267007086.png)
Hands On Engineering Manager
![SOCi](https://cdn.nolocation.io/companies/1661544362311902003.png)
Full Stack Software Engineer
![Zuplo](https://cdn.nolocation.io/companies/1663248605340975309.png)
Senior Front End Developer
![Tettra](https://cdn.nolocation.io/companies/1660719903484302286.png)
Customer Success Manager
![Angi](https://cdn.nolocation.io/companies/1659875416164910470.png)
Senior Software Engineer .NET Core
![Ethereum](https://cdn.nolocation.io/companies/1661544528551725780.png)
Front End TypeScript Developer
![Toptal](https://cdn.nolocation.io/companies/1660146888834119919.png)