Big Data Developer

Bigdata Developers

Remote

Mandatory Skills: Spark, Scala EMR and AWS

• 6+ years of related experience in designing and implementing enterprise applications using big data• 5+ yearsof experience in a senior level engineering role mentoring other engineers,which includes engineering best practices, unblocking, code reviews, unittesting, managing deployments, technical guidance, system design, etc.• 5+ yearsof experience working with large-scale data and developing SQL queries• Advancedexperience with scripting languages (e.g., Python, Bash, node.js) andprogramming languages (e.g., SQL, Java, Scala) to design, build, and maintaincomplex data processing, ETL (Extract, Transform, Load) tasks, and AWSautomation.• 5+ yearsof hands-on experience with AWS cloud services, such as Apache Spark, withScala, AWS EMR, Airflow, RedShift• 4+ yearsof experience with RESTFul APIs and web services• Excellentcommunication skills including discussions of technical concepts, soft skills,conducting peer-programming sessions, and explaining development concepts •In-depth understanding of Spark framework, scripting languages (e.g., Python,Bash, node.js) and programming languages (e.g., SQL, Java, Scala) to design,build, and maintain complex data processing, ETL (Extract, Transform, Load)tasks, and AWS automation. • A firm understanding of unit testing. • Possessin-depth knowledge of AWS services and data engineering tools to diagnose andsolve complex issues efficiently, specifically AWS EMR for big data processing.

Key Skills

• CSS
• Kafka