![](https://cdn.nolocation.io/companies/1704976234016076424.png)
Data Engineer Big Data
Job Description Develops and maintains scalable data pipelines Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization. Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it. Defines company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models. Designs data integrations and data quality framework. Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.Qualification: Bachelor's Degree in Computer Science or related field 5+ years of work experience Strong experience in SQL ( include complex SQL query , SQL performance tuning , Index , Lock ) Experience with schema design and dimensional data modeling Experience with Hive SQL , Spark(Spark SQL, DataFrame) Experience with near-realtime data warehouse (10-30 mins level) Experience with data quality check Experience in Java or Python or Shell Script
Key Skills
Related Jobs
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Security Engineer Ubuntu
![LimeSurvey](https://cdn.nolocation.io/companies/1660423335339479365.png)
Senior Software Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Test Automation Engineer
![Plenty of Fish](https://cdn.nolocation.io/companies/1661544872112376170.png)
Senior Android Engineer
![LeadSimple](https://cdn.nolocation.io/companies/1661544812266350309.png)
Lead Software Engineer
![Iterative](https://cdn.nolocation.io/companies/1660423210424072051.png)
Senior Frontend Engineer
![Wander](https://cdn.nolocation.io/companies/1660231993025589187.png)
Data Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Production Engineer
![Commit](https://cdn.nolocation.io/companies/1660155122581611122.png)
Senior Back End Developer
![AON3D](https://cdn.nolocation.io/companies/1662069060345636558.png)
Senior Frontend Engineer Platform
![Philo](https://cdn.nolocation.io/companies/1660474887673216995.png)
IT Engineer
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Senior Software Engineer Cloud Images
![Levity AI](https://cdn.nolocation.io/companies/1660642670139425624.png)
Senior Product Designer
![Clevertech](https://cdn.nolocation.io/companies/1660147397267007086.png)
Hands On Engineering Manager
![SOCi](https://cdn.nolocation.io/companies/1661544362311902003.png)
Full Stack Software Engineer
![Zuplo](https://cdn.nolocation.io/companies/1663248605340975309.png)
Senior Front End Developer
![Tettra](https://cdn.nolocation.io/companies/1660719903484302286.png)
Customer Success Manager
![Angi](https://cdn.nolocation.io/companies/1659875416164910470.png)
Senior Software Engineer .NET Core
![Ethereum](https://cdn.nolocation.io/companies/1661544528551725780.png)
Front End TypeScript Developer
![Toptal](https://cdn.nolocation.io/companies/1660146888834119919.png)