Director, Data Engineering

About the role

ScotiaTech, the technology hub of Scotiabank in Bogota, is looking for a visionary Director of Data Engineering. You will lead the transition from on‑premises and legacy cloud environments to Azure Databricks, shaping a modern lakehouse platform that powers analytics, AI/ML, and real‑time insights.

Key responsibilities

• Define and execute the data engineering roadmap for migrating on‑premises data systems to Azure.
• Lead, mentor and grow a high‑performing team of data engineers.
• Oversee end‑to‑end migration of pipelines, data stores and analytical workloads to Azure Databricks.
• Design scalable lakehouse architectures using Delta Lake, Unity Catalog and medallion patterns.
• Direct development and optimization of ETL/ELT, batch, streaming and incremental pipelines.
• Collaborate with data scientists, analysts, IT and business stakeholders to deliver tailored data solutions.
• Establish best practices for data governance, security, lineage and compliance.

Required profile

• Proven leadership experience managing data engineering teams in complex environments.
• Strong track record of cloud migration projects, preferably to Azure.
• Deep understanding of modern data architectures and lakehouse concepts.
• Excellent communication and stakeholder management skills.

Required skills

• Azure Databricks
• Delta Lake
• Unity Catalog
• Azure Data Lake Storage
• Apache Spark
• SQL
• Python / PySpark
• ETL/ELT pipeline design
• Data governance and security controls