Big Data Developer

Billennium is a Polish IT Company that has been developing innovative services and products for over 20 years, and provides the best outsourcing specialists.We implement IT projects and services in Poland and other European Union countries, as well as in the United States. We currently hire over 1800 Specialists in the field of the latest business support solutions and have 7 offices in Poland, India, Malaysia, Germany and Canada.Join a constantly growing team that work on projects for clients in many industries, including a global leader in pharmaceuticals industry, automotive, banking, insurance or the public sector.You will work in an international, innovative and engaging environment. You will be part of a highly motivated, dynamic and fun-loving team who is never afraid of taking on new challenges

We are seeking an experienced, innovative, and highly motivated engineer who is capable of working independently to design, develop, and support data engineering solutions for our Client. This role requires a considerable focus on understanding the data our Client deals with as an organization. You will need to develop a better understanding of our Client's data through profiling, take ownership of the solution design, work collaboratively with the wider engineering team to implement optimal solutions in a timely manner, and ensure the successful deployment and operation of the platform in production. Our Client platform helps solve complex business challenges pertaining to healthcare data, such as mapping a wide variety of healthcare drug and diagnosis data to standard coding frames. In this role, you will have the opportunity to solve complex engineering challenges and develop innovative solutions. In your daily work, you will be responsible for creating and delivering a platform for loading and processing millions of electronic medical records for our Client.

Job Responsibilities:Build pipelines for processing big amount of medical data,Participate in system design, development, deployment and maintenance,Configuration and prototyping of new systems,Conduct peer code reviews,Consistently and proactively expanding knowledge, network, and know-how to incorporate new thinking into current processes/products/tools/methods,Contribute to the definition and adoption of technical standards,Work closely with the data analysts to identify and provide required data,Create comprehensive automated unit and integration tests.

Qualifications:Bachelor's Degree in Information Technology, Software Engineering, Computer Science, Mathematics, or a related field,Over 6 years of experience in data engineering, including ETL design and implementation,3+ years of experience in batch processing,2+ years of experience in data analysis, profiling, integration, and reporting,Proficiency in SQL and Scala for over 4 years,Familiarity and expertise in Apache Spark, Kafka, Flink, and HDFS,Proven ability to work effectively as a team player,Exceptional analytical and troubleshooting skills,Strong collaboration, written, and verbal communication skills,Understanding of project management concepts, specifically Agile/Scrum.

Our offer:Permanent full-time contract (B2B/contract),Ability to work entirely remotely or in one of our cool offices around Poland,International project environment - challenging and rewarding projects,Access to private medical service, life insurance, and multisport card,Access to training and certificate courses (including free access to Udemy training platform),Cafeteria Benefits System - vouchers for purchases and services,Awesome company events and parties.

Key Skills

• SQL