Big Data Developer

Job Title: Big Data Engineer

Technology Stack:Client Side: React JS, Redux, Material UIServer Side: C#, .NET 8, Web APIsData Management: Azure Cognitive Search, Cosmos DB, SQL Server, Azure Storage Blob, Azure Storage TablesInfrastructure: Azure Functions, Logic Apps, Azure Web Apps, Redis Cache

Role Summary: We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in managing large-scale data systems and a deep understanding of our technology stack. Your primary responsibility will be to design, implement, and manage our big data infrastructure, ensuring high performance, reliability, and scalability.

Key Responsibilities:Design and implement scalable big data solutions using Azure Cognitive Search, Cosmos DB, and other relevant technologies.Work closely with the development team to integrate big data solutions with our existing applications, particularly focusing on data flow between client-side and server-side components.Develop and maintain SQL Server databases for authentication and identity data storage, ensuring data security and compliance.Manage Azure Storage solutions (Blob and Tables) for efficient data storage and retrieval, including files and logs data management.Utilize Azure Functions and Logic Apps to create event-driven, scalable data processing pipelines as needed.Implement caching mechanisms using Redis Cache to enhance application performance and user experience.Ensure data integrity, quality, and optimize data retrieval processes to support real-time data analytics.Collaborate with the development and operations teams to deploy big data solutions on Azure Web Apps and ensure seamless integration with our existing infrastructure.Stay abreast of the latest developments in big data technologies and Azure services to continuously improve our data infrastructure.

Qualifications:Bachelor's or Master's degree in Computer Science, Information Technology, or related field.Proven experience as a Big Data Engineer or similar role, with a deep understanding of big data technologies and Azure services.Strong proficiency in C#, .NET framework, and Web APIs.Experience with React JS, Redux, and Material UI is highly desirable.Expertise in Azure Cognitive Search, Cosmos DB, SQL Server, and Azure Storage solutions.Familiarity with Azure Functions, Logic Apps, and Azure Web Apps.Knowledge of Redis Cache and its application in data caching strategies.Excellent problem-solving skills, with the ability to design and optimize data-intensive applications.Strong communication and teamwork skills, with the ability to collaborate effectively with cross-functional teams.

Key Skills

• C#
• JavaScript