Lead Data Engineer(Snowflake Developer)

Egen is seeking a highly skilled Snowflake Data Engineer with expertise in data engineering, Snowflake, SQL, and strong experience in working with semi-structured data. The ideal candidate will have hands-on experience with various Snowflake data loading patterns, possess strong SQL skills for developing complex stored procedures, and be proficient in working collaboratively with business users to gather requirements and translate them into technical solutions. Additionally, experience with data streaming technologies will be advantageous.

Requirements: • Strong hands-on experience working with Snowflake as a data platform. • Demonstrated experience in handling semi-structured data in Snowflake and implementing incremental loading strategies. • Proficiency in various Snowflake data loading patterns, such as bulk loading, batch loading, and real-time streaming. • Extensive experience developing and optimizing large-scale SQL stored procedures (20+) for complex data processing. • Proven ability to collaborate effectively with business users to gather requirements and translate them into technical solutions. • Familiarity with data streaming technologies, such as Apache Kafka or AWS Kinesis, is preferred. • Solid understanding of data modeling, database design principles, and ETL processes. • Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data engineering challenges. • Excellent communication and interpersonal skills to effectively interact with cross-functional teams and stakeholders. • Bachelor's degree in Computer Science, Information Systems, or a related field (or equivalent work experience). Responsibilities: • Work with stakeholders to understand data requirements and design efficient data models and structures in Snowflake. • Develop and implement data loading strategies for semi-structured data in Snowflake, including designing approaches for incremental loading. • Utilize different Snowflake data loading patterns such as bulk loading, batch loading, and realtime streaming based on specific use cases and requirements. • Design, develop, and optimize large-scale SQL stored procedures to handle complex data processing and transformations. • Collaborate with business users to gather requirements, clarify needs, and translate them into technical specifications. • Develop and maintain data pipelines, ensuring the efficient and accurate flow of data into Snowflake. • Optimize query performance and ensure data integrity and consistency within Snowflake. • Stay up to date with emerging data engineering and Snowflake technologies, recommending and implementing best practices. • Collaborate with cross-functional teams, including data analysts, data scientists, and business stakeholders, to drive data-driven decision making

Key Skills

• SQL