Big Data Developer

Fiori Technology Solutions Inc. is looking for a skilled Big Data Engineer to join our dynamic team. As a Big Data Engineer, you will play a key role in designing, building, and maintaining our big data infrastructure and platforms. You will collaborate with cross-functional teams to develop scalable and robust data solutions that drive actionable insights for our organization. The ideal candidate will have a strong background in big data technologies, excellent problem-solving skills, and a passion for working with largescale data sets.

Responsibilities:Design, develop, and deploy scalable big data solutions using Hadoop, Spark, Kafka, Flink, and other open-source technologies.Build and optimize data pipelines to ingest, process, and transform large volumes of structured and unstructured data.Implement data storage solutions, including data lakes, data warehouses, and NoSQL databases, to support analytics and reporting requirements.Develop and maintain ETL processes for data integration and cleansing.Collaborate with data scientists and analysts to understand data requirements for machine learning and predictive analytics.Implement data governance and security policies to ensure the confidentiality, integrity, and availability of data.Monitor and optimize system performance, troubleshoot issues, and perform regular maintenance tasks.Stay current with emerging technologies and trends in big data and analytics, and make recommendations for technology adoption and innovation.Provide technical guidance and mentorship to junior engineers and contribute to the overall growth and development of the team.

Requirements:Bachelor’s degree in Computer Science, Engineering, or related field.5+ years of experience in big data engineering.Proficiency in big data technologies such as Hadoop, Spark, Kafka, Flink, HBase, and Hive.Experience with cloud platforms such as AWS, Azure, or GCP.Strong programming skills in languages such as Java, Scala, or Python.Knowledge of distributed computing and parallel processing frameworks.Experience with SQL and NoSQL databases.Excellent problem-solving and analytical skills.Strong communication and interpersonal skills.Ability to work independently and in a team environment.

Preferred Qualifications:Master’s degree in Computer Science or related field.Certification in big data technologies.Experience with data visualization tools and techniques.Knowledge of machine learning and data mining algorithms.Familiarity with DevOps practices and tools for CI/CD and automation.

Key Skills

• AWS