Hiring.Camp

Lead Data Engineer (AWS Data Platform)

NorthBay Solutions

·

Jul 9, 2026

Location
Karachi, Sindh
Workplace
Remote, Hybrid
Type
Full-time
Department
Engineering
Seniority
Lead
Experience
5+ years
Education
Bachelor
Closing date
Oct 7, 2026
Source
ApplyToJob

Description

Position: Lead Data Engineer (AWS Data Platform)
Experience: 5 to 8+ Years
Location: Hybrid (Pakistan)

Note: (Candidates must be available during UAE business hours and follow UAE public holidays)

Job Summary

We are seeking a highly skilled Lead Data Engineer with 5 to 8+ years of experience in designing, developing, and optimizing large-scale data platforms and ETL/ELT pipelines. The ideal candidate will have strong hands-on expertise in PySpark, AWS Glue, Amazon EMR, Amazon Redshift, and SQL-based data warehousing, along with proven experience in performance tuning and data optimization.

The candidate will work closely with a UAE-based customer and must be comfortable collaborating with distributed teams while adhering to UAE working hours and holiday schedules.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using PySpark, AWS Glue, and Amazon EMR.
  • Build and optimize data ingestion, transformation, and processing frameworks for structured and semi-structured data.
  • Develop and maintain enterprise data warehouse solutions using Amazon Redshift.
  • Write complex SQL queries, stored procedures, and data transformations to support analytics and reporting requirements.
  • Implement ETL/ELT processes to move data efficiently across multiple systems and platforms.
  • Perform performance tuning and optimization of Spark jobs, ETL pipelines, SQL queries, and Redshift workloads.
  • Ensure data quality, integrity, security, and governance across data platforms.
  • Troubleshoot production issues and perform root cause analysis for data-related incidents.
  • Collaborate with business stakeholders, analysts, architects, and engineering teams to understand data requirements.
  • Participate in code reviews, technical design discussions, and best-practice implementation.
  • Monitor data pipelines and proactively identify opportunities for performance improvements and automation.
  • Create and maintain technical documentation, data models, and operational procedures.

Required Skills & Experience

Must-Have Skills

  • 5 to 8+ years of experience in Data Engineering and Data Warehousing.
  • Strong hands-on experience with PySpark.
  • Extensive experience with AWS Glue.
  • Experience building and managing workloads on Amazon EMR.
  • Strong expertise in Amazon Redshift.
  • Excellent SQL development and query optimization skills.
  • Strong understanding of Data Warehousing concepts, dimensional modeling, and ETL/ELT processes.
  • Experience in performance tuning of Spark jobs, SQL queries, ETL pipelines, and data warehouse workloads.
  • Experience handling large-scale datasets and distributed data processing.
  • Strong debugging, troubleshooting, and analytical skills.

Preferred Skills

  • Experience with additional AWS services such as S3, IAM, CloudWatch, Lambda, and Step Functions.
  • Knowledge of CI/CD pipelines and DevOps practices for data platforms.
  • Experience with workflow orchestration tools.
  • Familiarity with data governance, security, and compliance practices.
  • Exposure to Agile/Scrum development methodologies.

Qualifications

  • Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field.
  • Relevant AWS certifications will be considered an advantage.

Soft Skills

  • Strong communication and stakeholder management skills.
  • Ability to work independently in a remote environment.
  • Excellent problem-solving and analytical thinking abilities.
  • Ability to collaborate effectively with cross-functional and geographically distributed teams.
  • Strong ownership mindset and commitment to delivering high-quality solutions.

Skills

AWSCI/CDSQLSparkData EngineeringETLAgileScrumDevOpsEMRCompliance

Similar Jobs

30

Lead Data Engineer

24hassistance

Lead Data Engineer

Techblocks·Gurugram, Haryana +1

Today

Lead Data Engineer

AmerisourceBergen is now Cencora! Explore our careers.·NCEE > Lithuania > Vilnius > Konstitucijos·Hybrid

Today

Lead Data Engineer

Integra Connect Careers

Lead Data Engineer

Mizuho Mizuho is in growth·New York, US·Hybrid

3d ago

Lead Data Engineer

Quilter·London, England +1

3d ago

Lead Data Engineer

Chubb·Wellington, Wellington Region·Hybrid

4d ago

Lead Data Engineer

Curatepartners·Onsite

6d ago

Lead Data Engineer

Honeywell·Atlanta, Georgia·Hybrid

1w ago

Lead Data Engineer

EXL Talent Acquisition Team·New Hampshire, US·Hybrid

1w ago

Lead Data Engineer

EXL·New Hampshire, US·Hybrid

1w ago

Lead Data Engineer

JP Morgan Chase·Irvine, California

1w ago

Lead Data Engineer

JP Morgan Chase·Irvine, California

1w ago

Lead Data Engineer

Verisma·Remote

1w ago

Lead Data Engineer

Oddball·Remote·Remote

1w ago

Lead Data Engineer

Radius·Crewe, England·Onsite

1w ago

Lead Data Engineer

Moneyfarm·Cagliari, Sardinia +1

Engineer Lead, Data

Fis·US

1w ago

Lead Data Engineer

Northrop Grumman·Cheltenham, England·Hybrid

1w ago

Lead Data Engineer

Northrop Grumman·Manchester, England·Hybrid

1w ago

Lead Data Engineer

Northrop Grumman·T011 GBR - Manchester - Capstan House, UK·Hybrid

1w ago

Lead Data Engineer

Northrop Grumman·T012 GBR - Cheltenham - Cheltenham House, UK·Hybrid

1w ago

Lead Data Engineer

Mtb·Buffalo, New York +1·Hybrid

1w ago

Lead Data Engineer

Alo Yoga·California, US

1w ago

Lead - Data Engineer

Cheq·India

Lead Data Engineer

Vodafone·London, England

1w ago

Lead Data Engineer

Genmills·India·Hybrid

1w ago

Lead Engineer Data

Empower·US·Remote

1w ago

Lead Data Engineer

Harborcapital·Chicago, Illinois·Hybrid

1w ago

Lead Data Engineer

3M·Minnesota, US·Onsite, Remote

1w ago