Master Data Developer – Cloud Data Platforms

About the role

CI&T is looking for a Master Data Developer to design, build, and optimise modern data platforms for its clients in Colombia. The role focuses on creating scalable data pipelines and lake architectures that enable data‑driven decision‑making across the organisation.

Key responsibilities

• Design, develop and maintain robust ETL/ELT processes for a modern Data Lake architecture.
• Build and optimise distributed data processing workflows using Python and PySpark.
• Implement partitioning strategies for storage frameworks such as Delta Lake or Apache Iceberg.
• Write, optimise and translate complex SQL queries with CTEs, window functions and aggregations.
• Migrate legacy data pipelines to cloud‑native analytics environments.
• Contribute to reusable code libraries following object‑oriented principles.
• Work with AWS services (Glue, Athena, Redshift, S3, Lambda, EventBridge) and provision resources via IaC tools (CloudFormation, CDK, Terraform).
• Monitor pipeline health with CloudWatch and other observability tools, ensuring reliability and performance.
• Maintain data integrity, consistency and compliance across pipelines and storage layers.

Required profile

• Proven experience as a data developer or engineer with strong expertise in distributed data processing.
• Deep knowledge of SQL and data modelling concepts.
• Hands‑on experience with AWS cloud services and infrastructure‑as‑code.

Required skills

• Python
• PySpark
• SQL (CTEs, window functions, aggregations)
• AWS Glue (Jobs, Catalog, Triggers, Workflows)
• AWS Athena
• AWS Redshift
• AWS S3
• AWS Lambda
• AWS EventBridge
• Delta Lake or Apache Iceberg
• CloudFormation, CDK or Terraform
• CloudWatch or similar observability tools