Data Engineer – Azure Databricks & Python (Remote)

About the role

As a Data Engineer, you will design and develop scalable data pipelines leveraging Azure Databricks and Python. You will play a key role in integrating AI capabilities into data workflows, enabling the organization to process complex datasets and automate intelligent classification tasks.

Key responsibilities

• Design, build, and optimize end‑to‑end data pipelines and Lakehouse architectures using Azure Databricks.
• Integrate LLM APIs and machine‑learning models into data processing streams to support automated classification and insights.
• Develop and maintain high‑quality Python code and SQL procedures for efficient data transformation and ingestion.
• Collaborate with AI and product teams to implement data‑driven solutions that deliver business value.
• Monitor and troubleshoot pipeline performance, ensuring reliability and scalability across distributed cloud environments.
• Implement data governance and security best practices to maintain platform integrity and compliance.

Required profile

• 4+ years of experience in Data Engineering, Machine Learning Engineering, or Software Engineering.
• Proven expertise in developing and optimizing data pipelines using Azure Databricks and Python.
• Proficiency in integrating ML/AI solutions and LLM APIs into automated data workflows.
• Strong background in data manipulation, automation, and supporting classification tasks.
• Deep understanding of cloud‑native data architectures and AI integration patterns.
• Advanced proficiency in English.

Required skills

• Azure Databricks
• Python
• SQL
• LLM APIs
• Machine Learning
• Cloud‑native data architectures

What we offer

• 100% remote work from anywhere.
• Competitive compensation in USD or local currency.
• Hardware and software setup for home office.
• Flexible hours to create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative, multicultural environment with global top‑talent collaboration.
• Mentorship, promotions, skill development, and diverse growth opportunities.