Lead Data Solutions & AI Engineer

About the role

Gallagher is looking for a Lead Data Solutions & AI Engineer to design and deliver data integration solutions that support BI and AI work across Azure and on-premises environments. The role turns complex data into reliable pipelines, reports and data usable for machine learning and AI, working on several complex, business-critical projects within a collaborative team.

Key responsibilities

• Design and deliver scalable data pipelines that move data from source systems into clean, trusted structures for reporting, analytics and machine learning.
• Work hands-on with data ingestion, transformation, validation and loading from APIs, databases, Azure Blob Storage, ADLS Gen2, third-party systems and on-prem SQL Server.
• Design and maintain ETL and ELT pipelines using Azure Data Factory, Azure Databricks, Synapse Analytics and Azure SQL, and support on-prem SQL Server integration, extraction, synchronization, replication and performance tuning.
• Write and optimise T-SQL queries, stored procedures, views and functions, and maintain data quality, lineage and governance.
• Troubleshoot ETL failures, data latency and production incidents, and support data models, data marts and feature stores.
• Develop, train, fine-tune, deploy and monitor AI and ML models, applying Azure security practices such as RBAC, Managed Identities, Azure Key Vault and private networking.
• Improve ETL, ELT and AI engineering processes through automation and modern Azure patterns.

Required profile

• 10+ years of experience in data solutions engineering, including 7+ years on the Microsoft platform.
• 7+ years designing and building large applications with SQL Server.
• Bachelor's degree in computer science, engineering or a related field, or equivalent experience.
• Advanced English level.
• Able to explain technical ideas clearly to managers, developers, vendors and systems teams, and able to lead a project team, shape a technology vision and give detailed estimates.

Required skills

• Azure Data Factory, Azure SQL, Azure Databricks, Synapse Analytics, Azure Functions, SQL Server, T-SQL, SSIS
• CI/CD pipelines and DevOps tools
• Python with NumPy, Pandas and PyArrow
• AI and machine learning solutions in the cloud, including vector databases