Senior Developer [Python, DataBricks, BigData]

[Searching for candidates located only in Poland]

Position: Big Data Python Engineer

Job Description:

We are seeking a highly skilled and experienced Big Data Python Engineer to lead the development and implementation of our digital, data, and analytics product within the Voluntary and Regulated Carbon Trading Business. This role is pivotal in supporting our customers in the Energy Transition journey. The successful candidate will play a crucial role in addressing one of the world’s most pressing challenges: delivering energy globally while mitigating the risks of climate change.Key Responsibilities:Design and implement robust big data solutions to process large volumes of data efficiently.Develop and optimize data processing pipelines using Python and Big Data technologies.Collaborate with cross-functional teams to integrate big data solutions into the broader analytics and data platforms.Contribute to the development of predictive models and analytics tools for carbon trading and risk assessment.Required Skills:Proficiency in Python, with a strong grasp of the Python scientific stack (including pandas, numpy, scipy, stats).Extensive experience with Big Data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms, preferably Azure.Solid SQL skills and experience with relational and non-relational databases, including data modeling and query optimization.Knowledge of quantitative methods and probabilistic modeling, with a background in financial derivatives valuation.Excellent communication skills and a team-oriented approach.Desirable Skills:Familiarity with Source Control Technologies (e.g., GitHub, Azure DevOps), CI/CD pipelines, and test automation.Understanding of AGILE, KANBAN, SCRUM methodologies.Proven ability in root cause analysis on complex data sets for business insights and process improvements.Background in Commodity/Financial Trading or Risk Modelling, with a strong understanding of risk management principles.Quantitative skills, including statistical methods for data analysis and interpretation.

Key Skills

• Python
• SQL
• Azure