Senior Data Engineer - Energy Trading Pipelines

About the role

Publicis Sapient is looking for a Senior Data Engineer to own the health, evolution and reliability of data pipelines feeding off ENDUR and the reporting layer built on Power BI. Prior knowledge of energy trading and ETRM concepts is a strong advantage, but Endur-specific skills are not mandatory, as selected candidates receive focused ETRM domain training during onboarding.

Key responsibilities

• Maintain and evolve Airflow-based pipelines pulling from ENDUR batches, including DAG execution, monitoring and configuration changes.
• Detect and resolve pipeline failures and data mismatches with minimal downtime and business disruption.
• Build Power BI data models and complete reporting solutions aligned with stakeholder needs.
• Author new pipeline transformations, optimize Spark jobs and refine advanced SQL queries.
• Drive root cause analysis and implement preventive solutions across data flows and reporting layers.
• Mentor junior engineers, enforce standards and contribute to proactive monitoring frameworks.

Required profile

• 6+ years of hands-on data engineering experience in production environments.
• Preferred: previous work in energy trading or BFSI risk/trading data platforms, and experience implementing monitoring, alerting and preventive reconciliation frameworks.
• Preferred: background in containerized workloads, Kubernetes or similar orchestration platforms, and evidence of effective incident response and on-call rotations.

Required skills

• Apache Airflow (DAG authoring, custom operators, retry logic, SLAs)
• Python with OOP and unit testing
• Advanced SQL (tuning, views, validations)
• Apache Spark
• Power BI end-to-end (data modeling, DAX, RLS)
• On-prem/hybrid lakehouse environments (MinIO, Apache Iceberg, Trino)
• Familiarity with CI/CD and test automation for pipelines and reports; ETRM experience preferred but not required

What we offer

• An inclusive workplace promoting diversity and collaboration.
• Ongoing learning and development opportunities.
• Competitive compensation and benefits, including health coverage for you and your family, generous paid leave and holidays, wellness program and employee assistance.
• Flexibility to support work-life balance.