It´s a presential position in Grenada - Spain
For more than 10 years Awywr has been supporting talents who wish to change their professional life and puts them in contact with recruiting companies all over the world.
Currently, we are supporting one of our clients in the technology sector is expanding its team with a Senior Developer (Python) profile for different projects of the company.
You will have the important responsibility of performing the following tasks and activities to take our client to the next level:Their client has started a greenfield project to build an in-house data lake solution, named Origin. This will serve various BI services and projects as well as other Data Science tools and initiatives within SCIB. Origin, will ingest near real-time market data from multiple sources and centrally store them on the cloud (AWS). The scope and type of the data consumed, and target consumers will continue to expand.Currently, the existing functionality include the following:Ingestion of multiple data sources in batch / near real-time in a shared storage.Decoupled storage from compute and data processing to provide increased scalability and performance while reducing storage costs.The data is compressed and partitioned using a parquet data formats which improves the performance while reducing the cost of the data retrieval.Centralized metadata catalogue that maintains a single view of the data model for all its consumers.Integration with other AWS services (Athena, EMR, QuickSight, ...) and third-party solutions (Apache Spark, Presto, Tableau, ...).The project is sponsored at high levels with-in the business and is a new initiative. Working in a small development team, the focus will be on delivering high quality solutions for electronic trading and pricing workflows. The aim of the project is to build an agile team that works closely with the business sponsors to ensure a high-quality platform that delivers on the needs of a global trading business.
Technical Skills Required:Very deep understanding of Python, Pyspark, Pandas, JulyterLab, Kafka Experience in SQL, Hive, Hadoop.Solid experience with continuous integration and continuous delivery tools like Git, Jenkins etc.Agile development/Software life cycle.English B2/C1Nice to have Skills:Experience with KafkaExperience using AWS platform.Specifically, experience using EMR (Elastic Map Reduce) in AWS to run Spark clusters.Knowledge of TerraformExperience with Ansible, Bash scripting, boto3Experience configuring continuous integration and continuous delivery tools.
Qualities & Skills:Energetic, motivated, and determinedPragmatic and results-orientedAdaptable to diverse set of technical responsibilitiesExcellent analytical and problem-solving skills.Productive and able to manage time effectively.Strong written and verbal communication skills
Qualifications:Bachelor degree in Computer Science / Information Technology or a related field, or substantial practical experience of software delivery at an advanced level