AWS Redshift Developer

Looking for an AWS Redshift Developer with 3-5 years of experience to design, implement, and optimize data warehousing solutions, leveraging Redshift for robust analytics and reporting.

Responsibilities:

Design, develop, test, and maintain data pipelines in AWS Redshift.Provide expertise in Redshift database optimization, performance tuning, and query optimization.Design and implement workflows using Airflow or Event Engine.Work closely with version control team (Git).Develop and maintain data models for Redshift databases, including schema design, table structures, and optimization techniques. Collaborate with data architects and stakeholders to understand requirements and translate them into efficient data structures.Design and implement Extract, Transform, Load (ETL) processes to extract data from various sources, transform it as per business requirements, and load it into Redshift.Develop efficient and scalable ETL workflows, considering data quality, performance, and data governance.Optimize query performance by creating appropriate data distribution keys, sort keys, and compression techniques. Identify and resolve performance bottlenecks, fine-tuning queries, and optimizing data processing to enhance Redshift's performance.Integrate Redshift with other AWS services, such as AWS Glue, AWS Lambda, Amazon S3, and more, to build end-to-end data pipelines. Ensure seamless data flow between different systems and platforms, maintaining data integrity and consistency.Implement monitoring and alerting systems to proactively identify issues and ensure the stability and availability of the Redshift cluster. Perform troubleshooting, diagnose and resolve data-related issues, and work closely with support teams to resolve any performance or operational problems.Plan and execute strategies for scaling Redshift clusters to handle increasing data volumes and user demands. Monitor resource utilization, track data growth, and make recommendations for capacity planning and infrastructure scaling.

Required Skills

AWS data lake solutionsData Modeling and DesignETL DevelopmentPerformance OptimizationMonitoring and TroubleshootingRedshift and other AWS services (DMS, Glue, Lambda, S3, Athena, Airflow)Python/Scala Programming Languages.Pyspark and Glue ETLCloudFormationAWS infrastructure (YAML, IAM)AWS tooling (CloudWatch logs, log insights, CloudTrail, IAM)DevOps toolsSQLAPI (API Gateway, Route structuring, API authentication)Shell scripting

Key Skills

• AWS Lambda