Hiring.Camp

Technical Lead Manager, ML Dataset Platform

Waabi

·

2 weeks ago

Location
San Francisco, CA · Toronto, ON · Pittsburgh, PA · Remote US & Canada
Workplace
Hybrid, Remote
Type
Full-time
Department
Software
Seniority
Manager
Source
Lever

Description

Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with technology that's powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.
 
With offices in Toronto, San Francisco, Dallas, and Pittsburgh, Waabi is growing quickly and looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: www.waabi.ai

As TLM of the ML Datasets Platform, you will play a critical role defining the APIs, tooling, and storage formats that make datasets a shared, first-class asset at Waabi: versioned, efficiently updatable, fully traceable, and fast to load across GPU workloads. The technical challenge is to find the right abstractions so that every ML team can integrate with the platform for its model development use case without being forced into a one-size-fits-all mold, and without building its own data infrastructure on the side. You will do this as a hands-on technical leader who also grows and manages the team, sets its roadmap, and partners closely with the ML Training Platform team and the ML development teams who are the platform's customers.
 

You will…

  • Lead and grow the ML Dataset Platform team as both its technical lead and people manager: set the technical direction, define the roadmap, hire, and mentor engineers.

  • Define the APIs, tools and storage formats for Waabi's ML datasets, balancing maximal reuse of data and tooling against the specific needs of each training workload.

  • Build the tooling to manage datasets at scale, including versioning and efficient incremental updates without full rebuilds.

  • Design the APIs that let teams express training-time transformations along the continuum between fully reproducible ahead-of-time ETL and dynamic transformation within data loaders.

  • Own the common dataloading tools used across workloads, including observability into bottlenecks and the throughput of training jobs.

  • Streamline data access for multi-cloud training so that datasets are available as needed with predictable cost and latency.

  • Make data lineage a first-class, fully automatic property of every dataset, from raw data through to the model trained on them.

  • Partner with the ML Training Platform team on the boundary between data and training infrastructure, and with the ML development teams on transitioning shared-dataset tooling into the new platform.

  • Drive adoption: work directly with model teams to migrate their training data onto the platform and feed what you learn back into your team’s roadmap.

 

Qualifications:

  • Deep ML dataset experience: You have designed and built large-scale data infrastructure for ML training (storage formats, dataset versioning, ETL, dataloading) and understand the performance characteristics of petabyte-scale sensor or multimodal data.

  • Strong software engineering and implementation: You have very strong Python skills and are comfortable in PyTorch training loops; you have strong software-engineering fundamentals and experience with distributed systems, cloud storage, and data processing frameworks (e.g., Spark, Ray, Beam).

  • Proven technical leadership: You have led a platform or infrastructure effort used by multiple teams, defined its APIs, and driven adoption across an organization.

  • People leadership: You have managed or tech-led a team of engineers, including hiring and mentoring, and can balance hands-on technical contribution with roadmap ownership and stakeholder management.

  • Team player: You communicate clearly with researchers and engineers, build consensus across teams with different needs, and deliver in a fast-paced environment.


Bonus:

  • Experience with ML data infrastructure in autonomous driving or robotics (multi-sensor logs, LiDAR, camera, HD maps).

  • Experience with columnar and tensor storage formats (e.g., Parquet, Lance, WebDataset, Zarr) and dataset versioning tools.

  • Experience with multi-cloud or hybrid training environments and the data-movement challenges that come with them.

  • Experience with data lineage, metadata catalogs, or feature-store systems.

Skills

PythonPyTorchSparkETL

Similar Jobs

30

Technical Lead Manager

Homebound·New York City, New York·Remote

1w ago

Manager / Technical Lead

Accenture·Albany, New York +41

3w ago

Technical Manager Lead

Galliford Try·UK

2mo ago

Technical Lead Manager

Hevodata·Bengaluru, Karnataka·Onsite

2mo ago

Technical Lead & Manager

Wisdom AI·Bengaluru, Karnataka·Onsite

5mo ago

Staff Technical Lead Manager, Ingestion

Protege·Remote·Remote

3d ago

Technical Lead Manager, Telematics

Motive·Hybrid - Bangalore·Hybrid

4d ago

Senior Manager, Technical Lead Oracle Lease Accounting and Procure to Pay (P2P/PTP)

ByrdGroup·Hybrid

Controls & Systems Engineering Manager / Technical Lead

Applied Materials·Benicia, California

1w ago

Controls & Systems Engineering Manager / Technical Lead

Amat·Benicia, California

1w ago

Senior Staff Technical Lead Manager - Mapping

Waymo·Mountain View, California·Remote

Software Manager | Technical Lead (Java)

Reolink·Singapore·Onsite

1w ago

Linear Infrastructure - Senior Project Manager/Technical Lead

Stantec·Fairfax, Virginia·Hybrid

1w ago

Senior Manager, Technical Lead Oracle Pricing & Service to Cash

Marriott Hotels & Resorts·Bethesda, Maryland

1w ago

Senior Staff Software Engineer Technical Lead Manager Vertical Ads On Maps

Google·Remote

Senior Project Manager/Technical Lead, Conveyance - New England

Stantec·Burlington, Massachusetts·Hybrid

2w ago

AES Salesforce Technical Lead/Manager

Crm Experienced Careers Site·Bengaluru, Karnataka

2w ago

Electronic Hardware Engineering Manager/ Technical Lead

Robert Bosch·Ho Chi Minh City, Vietnam·Onsite

3w ago

Project Manager Technical Lead

Paylocity·District of Columbia, US

3w ago

Senior Project Manager/ Technical Lead, Conveyance

Stantec·Toronto, Ontario·Hybrid

3w ago

Technical Lead Manager Applied Ai Deepmind

Google·Remote

Technical Lead Manager Discover Ranking

Google

Technical Lead Manager, AI Platform

Paraform·San Francisco, California

1mo ago

Controls & Systems Engineering Manager / Technical Lead

Amat·Benicia, California

1mo ago

Controls & Systems Engineering Manager / Technical Lead

Applied Materials·Benicia, California

1mo ago

Senior Manager, Technical Lead Oracle Reporting & Analytics

Marriott Hotels & Resorts·Bethesda, Maryland

1mo ago

Technical Lead Manager, Forward Deployed Engineering

Veeam Software·San Jose, California·Remote

1mo ago

Technical Lead Manager, Motion Validation

Nuro·Los Angeles, California +1

Technical Lead Manager, Pullover Manuevers

Waymo·Mountain View, California +1

Technical Lead Manager, Content Management Systems

Oura·US·Remote

2mo ago