Hiring.Camp

Lead Data Engineer - Databricks & Microsoft Fabric

Spyglass

·

May 8, 2026

Location
Lincoln, RI
Department
Engineering
Seniority
Lead
Experience
7+ years
Source
Paylocity

Description

Description

 Location: Remote (Preference for candidates located in New England)
Engagement: Contract or Contract-to-Hire 


Lead Data Engineer

Databricks & Microsoft Fabric


Overview

Spyglass MTG is seeking a highly skilled Lead Data Engineer with strong expertise in Databricks and Microsoft Fabric to help design, build, and scale modern data platforms in Azure.

This role is both strategic and hands-on. The ideal candidate will lead the development of enterprise data solutions while actively building scalable pipelines, lakehouse architectures, and data platforms that support analytics, reporting, and AI initiatives.

The Lead Data Engineer will work closely with data architects, analysts, and business stakeholders to deliver high-performance data solutions that enable organizations to leverage their data more effectively.


Responsibilities

• Design and implement modern data platforms using Databricks and Microsoft Fabric
• Build and maintain scalable data pipelines and ingestion frameworks
• Develop and optimize Spark and PySpark workloads within Databricks
• Implement lakehouse and data warehouse architectures
• Design and manage data models supporting analytics and reporting
• Collaborate with data scientists and analytics teams to support AI and advanced analytics initiatives
• Implement data quality, governance, and security best practices
• Provide technical leadership and mentorship to data engineering team members
• Optimize performance, reliability, and scalability of data platforms


Requirements


• 7+ years of experience in data engineering or data platform development 

• Strong hands-on experience with Databricks and Apache Spark  

• Experience implementing Microsoft Fabric data solutions  

• Proficiency in Python and PySpark  

• Experience working with Azure data services and cloud-based data platforms  

• Experience designing modern lakehouse or data warehouse architectures  

• Strong understanding of data pipeline design, ETL/ELT processes, and data modeling


Preferred

• Experience supporting AI or machine learning workloads  

• Experience working in enterprise data environments  

• Familiarity with CI/CD and data platform automation 

Skills

PythonAzureCI/CDMachine LearningSparkDatabricksData EngineeringETL

Similar Jobs

30

Lead Data Engineer

Appian Corporation·McLean, Virginia·Onsite

Today

Data Engineer, Lead

Seattlechildrens·US·Hybrid

1d ago

Lead Data Engineer

Softeta·Kraków, Lesser Poland·Remote

1d ago

Lead Data Engineer

AIR Communities·Denver, Colorado·Onsite

1d ago

Lead Data Engineer

Havering Candidate Experience Site·Romford, England

1d ago

Lead Data Engineer

Stuut Technologies·New York City, New York +1·Hybrid

2d ago

Lead Data Engineer

AND Digital·Birmingham, England·Hybrid

2d ago

Data Engineer, Lead

Booz Allen Hamilton·McLean, Virginia·Hybrid

2d ago

Lead Data Engineer

Ecolab·India

3d ago

Lead Data Engineer

Asiapac Aptean·Bengaluru, Karnataka

3d ago

Lead Data Engineer

Ssctech·Bangkok, Thailand·Hybrid

3d ago

Lead Data Engineer

Prove·New York City, New York·Hybrid

3d ago

Lead Data Engineer

Nasdaq·Canada·Hybrid

4d ago

Lead Data Engineer

Professional Kyndryl·Hyderabad, Telangana +1·Remote

4d ago

Lead Data Engineer

Professional Kyndryl·Hyderabad, Telangana +1·Remote

4d ago

Lead Data Engineer

24hassistance

Lead Data Engineer

Techblocks·Gurugram, Haryana +1

5d ago

Lead Data Engineer

AmerisourceBergen is now Cencora! Explore our careers.·NCEE > Lithuania > Vilnius > Konstitucijos·Hybrid

5d ago

Lead Data Engineer

Integra Connect Careers

Lead Data Engineer

Mizuho Mizuho is in growth·New York, US·Hybrid

1w ago

Lead Data Engineer

Quilter·London, England +1

1w ago

Lead Data Engineer

Chubb·Wellington, Wellington Region·Hybrid

1w ago

Lead Data Engineer

Honeywell·Atlanta, Georgia·Hybrid

1w ago

Lead Data Engineer

JP Morgan Chase·Irvine, California

1w ago

Lead Data Engineer

JP Morgan Chase·Irvine, California

1w ago

Lead Data Engineer

Verisma·Remote

1w ago

Lead Data Engineer

Oddball·Remote·Remote

2w ago

Lead Data Engineer

Radius·Crewe, England·Onsite

2w ago

Lead Data Engineer

Moneyfarm·Cagliari, Sardinia +1

Engineer Lead, Data

Fis·US

2w ago