Data Engineer – Databricks

About the role

We are looking for a skilled Data Engineer specialized in Databricks to design, build, and optimize high‑throughput, production‑grade data pipelines on the Databricks Lakehouse platform. The role is fully remote and open to mid‑senior and senior candidates across Latin America.

Key responsibilities

• Design, develop, and maintain automated ETL/ELT pipelines using PySpark, Delta Lake, Databricks Workflows or Delta Live Tables.
• Implement Medallion Architecture (Bronze, Silver, Gold) to transform raw clinical data into analytics‑ready models.
• Ingest and normalize healthcare data sources such as Epic EHR, FHIR/HL7 feeds, and third‑party claims systems.
• Enforce data governance, row/column‑level security, and HIPAA compliance using Unity Catalog.
• Optimize compute utilization, query performance, and Delta table indexing to reduce latency and cost.
• Collaborate with US‑based data scientists, BI developers, and clinical stakeholders to deliver reliable data products.

Required profile

• 4+ years of production data engineering experience, with at least 2 years on Databricks.
• Advanced English (C1/C2) for daily collaboration with Boston‑based teams.
• Strong analytical rigor and passion for improving healthcare outcomes.

Required skills

• PySpark, Python, SQL
• Databricks Lakehouse ecosystem: Delta Lake, Databricks SQL, Unity Catalog
• Cloud platforms: AWS S3/EMR or Azure ADLS Gen2/Data Factory
• Version control and CI/CD: Git, deployment pipelines
• Data validation frameworks (e.g., Great Expectations)
• Healthcare data standards (FHIR, HL7, OMOP, ICD‑10/CPT) – preferred

What we offer

• Competitive base salary
• Comprehensive benefits and wellness support
• Flexible work model: hybrid, remote, or in‑office
• Real growth opportunities and leadership visibility
• Inclusive, respectful culture blending U.S. innovation with Colombian heart