Senior Data Developer - Quality/Observability

General DescriptionWe are seeking a highly skilled Data Quality/Observability Developer to join our data engineering team. In this role, you will ensure the quality, reliability, and performance of batch and streaming data pipelines. You will also design, implement, and maintain robust data quality and observability frameworks to detect, diagnose, and resolve data issues proactively.

ResponsibilitiesDevelop and implement data quality frameworks and metrics for batch and streaming data pipelines.Design and build end-to-end observability solutions to monitor data pipelines, identify anomalies, and ensure data integrity.Collaborate with data engineers, DevOps engineers, and business stakeholders to define data quality requirements and standards.Conduct root cause analysis of data quality issues and implement corrective actions.Develop and maintain data quality documentation and reports.Stay up-to-date with the latest data quality and observability technologies and best practice

Requirements for this challenge:Strong experience in data quality and observability for both batch and streaming data pipelines.Proven expertise in AWS, including services like S3, ECS, Kinesis, and MSK.Proficiency in SQL and Python.Experience with data quality and observability tools and frameworks.Strong analytical and problem-solving skills.Proficiency in English for communication.

Nice to Have:Experience with Azure and Databricks platforms.Experience using DevOps and Terraform.Knowledge of data governance and data lineage.

Our benefits:- Health plan and dental plan;- Meal allowances;- Extended parenting leave;- Annual profit-sharing distribution;- Life insurance;- Partnership with an online mental health platform;- CI&T University;- Support Program: psychological guidance;- Partnership with online course platforms- Platform for language learning;- And many others.

#LI-JP3#MidSenior

Key Skills

• AWS
• Python
• SQL
• Azure