Senior Data Engineer
UBDS Group
·Today
- Location
- London, England, United Kingdom · Manchester, England, United Kingdom
- Workplace
- Hybrid
- Department
- UBDS Group Holdings
- Seniority
- Senior
- Source
- Workable
Description
At UBDS, we help organisations transform through cloud, cyber security, AI and digital innovation. We're looking for an experienced Senior Data Engineer to support the design, development and delivery of modern data solutions within Microsoft Azure environments.
This is a hands-on engineering role focused on building scalable data pipelines, integrating data services and delivering secure, reliable cloud-based data solutions. You'll work closely with Data Architects, Cloud Engineers and wider delivery teams to develop robust data platforms that support business intelligence, analytics and digital transformation.
You'll also play an important role in embedding data governance, automation and engineering best practices, ensuring solutions are secure, maintainable and aligned with enterprise standards.
What You'll Do
- Design, develop and maintain scalable data pipelines and integration solutions using Microsoft Azure.
- Build and support cloud-based data services, storage and processing capabilities.
- Develop automated data ingestion, transformation and processing workflows.
- Implement data governance and management practices aligned with Microsoft Purview.
- Support data quality, lineage, classification and appropriate access controls.
- Develop and maintain CI/CD pipelines to automate data platform deployments.
- Support Azure infrastructure configuration and secure deployment of data services.
- Apply Infrastructure as Code and modern DevOps engineering practices.
- Develop and maintain integrations between data platforms, applications and cloud services.
- Support the secure deployment and integration of cloud-based analytics and data processing capabilities.
- Optimise data pipelines for performance, scalability, reliability and cost efficiency.
- Troubleshoot complex data processing, integration and deployment issues.
- Collaborate with Architects, Engineers and stakeholders to translate requirements into effective technical solutions.
- Contribute to technical design, code reviews, engineering standards and documentation.
- Work within Agile delivery teams, supporting iterative development and continuous improvement.
What We're Looking For
- Strong experience as a Data Engineer or Senior Data Engineer within cloud-based environments.
- Hands-on experience developing and supporting data solutions using Microsoft Azure.
- Experience designing and building ETL/ELT pipelines and data integration workflows.
- Experience working with Azure data services and cloud-based storage technologies.
- Understanding of Microsoft Purview and data governance principles.
- Experience with CI/CD pipelines, deployment automation and version control.
- Knowledge of Azure infrastructure, networking, identity and security fundamentals.
- Experience implementing secure, scalable and maintainable data solutions.
- Strong understanding of data modelling, transformation and integration principles.
- Good software engineering practices, including testing, documentation and code quality.
- Strong analytical, troubleshooting and problem-solving skills.
- Experience working within Agile, multidisciplinary delivery teams.
- Strong communication and stakeholder engagement skills.
Desirable Experience
Experience across some of the following would be beneficial:
- Azure Data Factory, Azure Databricks or Microsoft Fabric.
- Azure Data Lake Storage and Azure SQL.
- Python, SQL and PySpark.
- Microsoft Purview data cataloguing, lineage and governance.
- Terraform, Bicep or other Infrastructure as Code tooling.
- Azure DevOps or GitHub Actions.
- Data lake, lakehouse and modern data platform architectures.
- Data security, encryption and access management.
- Experience supporting cloud-based analytics or AI-enabled data platforms.
- Experience delivering solutions within Government, Defence or other regulated environments.
- Relevant Microsoft Azure or data engineering certifications.
Security Clearance
This role requires candidates to successfully complete Baseline Personnel Security Standard (BPSS) checks.
Any appointment will be subject to the required pre-employment screening and security checks.
The Opportunity
This role would suit an experienced Data Engineer who enjoys hands-on technical delivery and building modern, scalable data solutions.
You'll work alongside experienced Data, Cloud and Engineering specialists, contributing to the delivery of secure, reliable data platforms and helping organisations make better use of their data.
You'll also have the opportunity to influence engineering practices, improve automation and contribute to the continued development of UBDS's Data and Digital capabilities.