Senior Developer – Azure Databricks

Company Description

👋🏼 We're Nagarro.

We are a digital product engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18,500+ experts across 36 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in!

By this point in your career, it is not just about the tech you know or how well you can code. It is about what more you want to do with that knowledge. Can you help your teammates proceed in the right direction? Can you tackle the challenges our clients face while always looking to take our solutions one step further to succeed at an even higher level? Yes? You may be ready to join us.

Job Description

As a Senior Developer, you will work closely with cross-functional teams to deliver high-quality solutions in domains such as Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.

Responsibilities:

Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lakeDesign and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks Developing scalable and re-usable frameworks for ingesting data sets Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanismsWorking with event based / streaming technologies to ingest and process dataProvide technical guidance and support to the team, resolving any technical challenges or issues that may arise during the migration and post-migration phasesStay up to date with the latest advancements in cloud computing, data engineering, and analytics technologies, and recommend best practices and industry standards for implementing the data lake solution.

Qualifications

4 to 10 years of IT experience Min. 4 years of Experience working with Azure DatabricksExperience in Data Modelling & Source System AnalysisFamiliarity with PySparkMastery of SQL Knowledge of components: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL Experience with Python programming language used for data Engineering purposesAbility to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flowsExperience in data visualization/exploration toolssProviding Technical leadership and guidance to TeamsStrong problem-solving skills and the ability to translate business requirements into actionable data science solutionsExcellent communication skills, with the ability to effectively convey complex ideas to technical and non-technical stakeholdersStrong team player with excellent interpersonal and collaboration skillsAbility to manage multiple projects simultaneously and deliver high-quality results within specified timelines.

Additional Information

Will be considered as an advantage but are not required:

Microsoft Certified: Azure Data Engineer AssociateExperience preparing data for Data Science and Machine LearningKnowledge of Jupyter Notebooks or Databricks Notebooks for Python development

Key Skills

• Python
• Azure
• Data Science