Data Engineer

About the role

Solvd is looking for a highly skilled Data Engineer to design and build modern data platforms that support large‑scale risk and compliance initiatives for enterprise clients. In this role you will architect and implement scalable data systems, real‑time pipelines, and analytics capabilities that transform complex datasets into actionable insights.

Key responsibilities

• Design, build, and optimise scalable data infrastructure for risk and compliance workloads.
• Develop batch and streaming pipelines using modern big data technologies.
• Implement robust ETL/ELT workflows across diverse structured and unstructured data sources.
• Work extensively with AWS services such as EMR, Redshift, S3, Glue, Lambda, Kinesis, and Firehose.
• Build high‑throughput, low‑latency systems that support real‑time or near‑real‑time decision making.
• Partner with data scientists, analysts, and engineering teams to deliver reliable, well‑documented datasets.
• Mentor team members and contribute to best‑practice frameworks within Solvd.
• Streamline reporting, analytics, and data preparation processes by automating manual workflows.

Required profile

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field.
• 3+ years of hands‑on experience in data engineering or related disciplines.
• Strong proficiency in SQL and data modelling for analytics and warehousing.
• Experience building ETL/ELT pipelines at scale.
• Experience with big data technologies such as Hadoop, Hive, Spark, HBase, or EMR.
• Basic scripting skills in Python or Scala.
• Preferred: Experience with AWS data services (Redshift, S3, Glue, EMR, Kinesis, Firehose, Lambda).
• Preferred: Experience with non‑relational data stores (document, key‑value, column‑family, graph).
• Preferred: Strong understanding of data governance, quality, and security best practices.

Required skills

• SQL
• Data modelling
• Hadoop
• Hive
• Spark
• HBase
• EMR
• Python
• Scala
• AWS Redshift
• AWS S3
• AWS Glue
• AWS Lambda
• AWS Kinesis
• AWS Firehose