Our client is seeking a Senior Big Data Engineer to become part of the team implementing and supporting edge analytical solutions on a Google Cloud Ecosystem. You will find a great place to work if you are passionate about designing data ingestion jobs, learning new technologies, and proposing and adopting new technologies.
Candidate’s LOCATION: Poland
Responsibilities:Extract, Transform and Load data from multiple sources and multiple formats using Big Data Technologies.Development, enhancement, and support of data ingestion jobs from various source systems following existing design patterns using GCP Services such as Apache Spark, Dataproc, Dataflow, BigQuery, Airflow, etc.Work across Teams and senior engineers to make Data more accessible to others within the organization.Modify data extraction pipelines into standardized approaches that can be repeatable and reusable with minimal supervision from senior engineers.Automation of manual processes, optimize data delivery, re-designing infrastructure for greater scalability, etc.Work closely with senior engineers to optimize query and data access techniques.Apply modern software development practices (serverless computing, microservices architecture, CI/CD, infrastructure-as-code, etc.)Participate in a tight-knit engineering team employing agile software development practices.
Requirements:Bachelor’s degree in Computer Science, Systems Engineering, or equivalent experience.5+ years of work experience as a Big Data Engineer.3+ years of experience using Technologies such as Apache Spark, Hive, HDFS, and Beam.Working experience with Dataflow, Dataproc, composer, and datastream.3+ years of experience in SQL and Scala or Python.2+ years experience with software build management tools like Maven or Gradle.2+ years of experience working with Cloud Technologies such as GCP, AWS or Azure.
Will be a plus:Data Engineering using GCP Technologies (BigQuery, DataProc, Dataflow, Composer, DataStream, etc)Self-starter who identifies/responds to priority shifts with minimal supervisionSource code control management systems (e.g. SVN/Git, Github) and build tools like Maven & Gradle.Agile environments (e.g. Scrum, XP)Relational databases (e.g. SQL Server, Oracle, MySQL)Atlassian tooling (e.g. JIRA, Confluence, and Github)
We offer:Flexible schedule and opportunities to work remotely (8 hours workday).Friendly professional staff and warm atmosphere.The environment where you can implement your ideas.Paid vacations and sick leaves.Medical insurance.Opportunity to work remotely.Participation in educational activities and thematic conferences.Team parties and corporate events.
Related Jobs
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Security Engineer Ubuntu
![LimeSurvey](https://cdn.nolocation.io/companies/1660423335339479365.png)
Senior Software Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Test Automation Engineer
![Plenty of Fish](https://cdn.nolocation.io/companies/1661544872112376170.png)
Senior Android Engineer
![LeadSimple](https://cdn.nolocation.io/companies/1661544812266350309.png)
Lead Software Engineer
![Iterative](https://cdn.nolocation.io/companies/1660423210424072051.png)
Senior Frontend Engineer
![Wander](https://cdn.nolocation.io/companies/1660231993025589187.png)
Data Engineer
![Covariant](https://cdn.nolocation.io/companies/1662068976948151470.png)
Production Engineer
![Commit](https://cdn.nolocation.io/companies/1660155122581611122.png)
Senior Back End Developer
![AON3D](https://cdn.nolocation.io/companies/1662069060345636558.png)
Senior Frontend Engineer Platform
![Philo](https://cdn.nolocation.io/companies/1660474887673216995.png)
IT Engineer
![Canonical - Jobs](https://cdn.nolocation.io/companies/1660042917895383454.png)
Senior Software Engineer Cloud Images
![Levity AI](https://cdn.nolocation.io/companies/1660642670139425624.png)
Senior Product Designer
![Clevertech](https://cdn.nolocation.io/companies/1660147397267007086.png)
Hands On Engineering Manager
![SOCi](https://cdn.nolocation.io/companies/1661544362311902003.png)
Full Stack Software Engineer
![Zuplo](https://cdn.nolocation.io/companies/1663248605340975309.png)
Senior Front End Developer
![Tettra](https://cdn.nolocation.io/companies/1660719903484302286.png)
Customer Success Manager
![Angi](https://cdn.nolocation.io/companies/1659875416164910470.png)
Senior Software Engineer .NET Core
![Ethereum](https://cdn.nolocation.io/companies/1661544528551725780.png)
Front End TypeScript Developer
![Toptal](https://cdn.nolocation.io/companies/1660146888834119919.png)