REQ ID – 27804995ROLE – ETL Developer / Data EngineerLOCATION – Remote MAIN SKILLS – Coding Python/ Pyspark/ Scala, Have strong experience building data pipeline, Exp with Big data frameworks: Spark, Cloud data exp- AWS
ResponsibilitiesDevelop, debug and enhance large-scale ETL batch jobs that transforms large amounts of data Develop utilities and toolkits to speed up engineering tasks and consolidate repetitive manual tasks executed by engineers while performing data investigationsProgramming in at least one of the following languages: Java, Python, Scala
Required SkillsProgramming language - Python, Java, or ScalaFamiliarity with Git or similar version control systemGood understanding of data processing concepts and data engineering process.Able to frequently collaborate closely with a diverse tight-knit teamExperience investigating and/or debugging problemsAble to track, analyze, and report issues in a timely mannerAttention to detail and a commitment to quality, while delivering work on scheduleHighly organized and efficientFlexibility to respond and react to changing priorities quickly and efficientlyExcellent oral and written communication in English
Highly Desired SkillsBig data processing, e.g. Spark/HadoopCloud based services, e.g. AWSWorkflow management tools, e.g. Apache AirflowSQLQA/QE