Data Engineer

Data Engineer

Job Overview

We are seeking an experienced and highly motivated Data Engineer to design, build, and maintain scalable, reliable, and high-performing data platforms and pipelines. The ideal candidate will have experience working with large-scale data ecosystems and modern cloud-based data technologies, with a strong focus on data quality, validation, cleansing, and governance.

This role requires a self-directed individual who can work independently, partner with clients and stakeholders, and contribute to strategic initiatives. The successful candidate will be technology agnostic, adaptable to evolving technology landscapes, and passionate about continuously improving processes, standards, and ways of working.

Key Responsibilities

Data Engineering & Architecture

• Design, develop, and maintain scalable data pipelines and ETL/ELT frameworks.
• Build and optimize data solutions for processing large volumes of structured and unstructured data.
• Design and implement modern data architectures that support analytics, reporting, machine learning, and business intelligence initiatives.
• Ensure data platforms are secure, reliable, scalable, and maintainable.
• Support real-time and batch data processing requirements.

Data Quality & Governance

• Develop and maintain data validation, data quality, and data cleansing processes.
• Implement monitoring, auditing, and alerting mechanisms to ensure data integrity.
• Identify and resolve data anomalies, inconsistencies, and performance bottlenecks.
• Establish best practices for data governance, lineage, and metadata management.

Platform Development

• Develop and support solutions using:
• Databricks
• Snowflake
• Azure Synapse Analytics
• SQL Server
• PostgreSQL
• Cloud and hybrid data platforms
• Optimize database performance, query execution, and storage strategies.
• Support data migration, modernization, and integration initiatives.

Required Skills & Experience

Technical Skills

• 4 years of experience designing, building, and maintaining data platforms and solutions.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
• Experience with technologies like:
• Databricks
• Snowflake
• Azure Synapse Analytics
• Microsoft SQL Server
• PostgreSQL
• SQL development and optimization
• Experience developing ETL/ELT pipelines and integrating data from multiple sources.
• Strong understanding of data modelling, data warehousing, and lakehouse architectures.
• Experience implementing data quality, validation, cleansing, and reconciliation processes.
• Knowledge of cloud-based data platforms and modern data engineering practices.
• Familiarity with CI/CD, DevOps, automation, and infrastructure-as-code principles is desirable.
• Self-motivated and capable of working independently with minimal supervision.
• Proven ability to support client initiatives and deliver business outcomes.
• Comfortable working across diverse technologies and adapting to changing technical environments.
• Positive, collaborative, and solutions-focused attitude.