Hiring.Camp

Research Scientist, Hand Tracking & Manipulation - ON-SITE

Targeted Talent

·

Oct 15, 2026

Workplace
Onsite
Type
Full-time
Department
Education
Source
RecruiterFlow

Description

Research Scientist, Hand Tracking & Manipulation

Location: New York, Toronto or Vancouver (on-site) 

Type: Full-time · Openings: 1 

Salary: US$170K – $210K + equity

The role

Architect and train proprietary foundation models from scratch for 3D hand tracking and articulated pose estimation. This role targets a critical bottleneck in embodied AI: dexterous manipulation and hand-object interaction. You'll build in-house equivalents to leading 3D hand and mesh recovery architectures, plus robust interaction models for heavily occluded egocentric manipulation. You'll train on a large, continuous stream of proprietary ground-truth manipulation data.

What you'll do

  • Design, implement and train state-of-the-art networks for 3D hand pose estimation, dense mesh recovery and kinematic tracking
  • Scale multi-view and temporal architectures across multi-GPU clusters on massive datasets of hands in action
  • Develop novel loss functions that enforce biomechanical constraints, temporal smoothness and physical plausibility
  • Build models robust to motion blur, severe self-occlusion and rapid rotation in first-person manipulation
  • Track objects through complex grasps, segment tools from hands, and map contact points and forces for downstream robotics models
  • Rapidly prototype models for tactile-visual fusion, fine-grained action segmentation and new hardware sensors
  • Feed tracking outputs into pipelines that reason about contact surfaces and object affordances, bridging human video and robot control policies

What you bring

  • Deep expertise in deep learning, 3D computer vision and articulated tracking / hand pose estimation
  • Proven experience training large-scale vision models from scratch, beyond inference or fine-tuning existing checkpoints
  • Strong grasp of parametric hand models (e.g., MANO), inverse kinematics and dense mesh estimation
  • Mastery of PyTorch and deep learning scaling frameworks
  • Experience curating multi-terabyte image and video training datasets
  • Comfort in a fast-paced environment where priorities shift with new research or hardware

Strong signals

  • First-author publications at CVPR, ICCV, ECCV or NeurIPS on 3D hand tracking, hand-object interaction, dexterous manipulation or human mesh recovery
  • Work with egocentric manipulation datasets (e.g., Ego4D, Ego-Exo4D, DexYCB, EPIC-KITCHENS)
  • Custom CUDA kernels for 3D operations, differentiable mesh rendering or collision/contact computation

Please note: Research Scientist roles require highly specific expertise. Apply to only one research role; you may also apply to non-research roles.

Skills

Deep LearningComputer VisionPyTorch

Similar Jobs

30

Senior Data Scientist Research And Development Infrastructure Deepmind

Google

Research Scientist and M-GEMINI Director of Biochemical Analytics

Mcw·US·Onsite

2d ago

Staff Scientist, Research and Development

Thermofisher·San Francisco, California +2·Onsite

1mo ago

2027 Intern - Applied and Research Scientist/Engineer

Adobe·Cambridge, England +5·Hybrid

1mo ago

Staff Scientist, Research and Development

Thermofisher·Sunnyvale, California·Onsite

3mo ago

DOE - NNSA Senior Scientist - Research and Development (TEPSIII32) (CONUS - Washington, DC (Remote) | Senior Consultant - Full-Time)

ProSidian Consulting·District of Columbia, US·Remote

1y+ ago

Hydrometeorology Assistant Research and Field Scientist

Nshe·DRI - Reno, NV·Onsite

3d ago

Research Scientist, Antigen and Therapeutic Protein Production – Downstream Processing

Novartis·Basel, Basel-City·Onsite

4d ago

Research Scientist, Antigen and Therapeutic Protein Production – Downstream Processing

Novartis·Basel, Basel-City·Onsite

4d ago

PP Catalyst Research and Development Scientist

INEOS is·Texas, US

5d ago

Research Scientist Climate And Energy

Google·Remote

Post-Training Research Scientist - Forecasting and Reasoning

Point72·New York City, New York

1w ago

Assistant Research Scientist - Dissemination and Implementation

Careers With Purpose·US

1w ago

Laser Ablation, Automation and Digitisation Research Scientist

Unimelb·Parkville, Victoria

1w ago

Research Scientist, AI and Systems Security - PhD New College Grad 2026

Nvidia·Santa Clara, Villa Clara Province +1

2w ago

Research Scientist, AI and Systems Security - PhD New College Grad 2026

Nvidia·Santa Clara, California +1

2w ago

ELISA Method Development and Validation Research Scientist I

Eurofins Scientific·Lenexa, Kansas·Onsite

2w ago

Senior Research Scientist Conversational And Agentic Systems Google Research

Accounts·Remote

Research Scientist – Neutron and X-ray Scattering

Argonne·Lemont, Illinois·Onsite

2w ago

Senior Research Scientist - Psychiatry and Behavioral Sciences

University of Kansas Medical Center·US

2w ago

Senior Research Scientist, EDA and AI

Nvidia·Santa Clara, California

3w ago

Senior Research Scientist, EDA and AI

Nvidia·Santa Clara, California

3w ago

Reference Standard and Development Stability Scientist - Bioproduct Research and Development

Lilly·US

1mo ago

Neuropathology Research Scientist Brain and Body Donation Program

Bannerhealth·US

1mo ago

Computer and Information Research Scientist - SecretAberdeen Proving Ground, MD

33704Placement·Remote

Lead Research and Development Scientist/Engineer I

Gentex Corp·US

1mo ago

Research Scientist, Ingredient and Product Science

Herbalife·Torrance, California

1mo ago

Scientist- Analytical Research and Development

Pfizer·US

1mo ago

Scientist- Analytical Research and Development

Pfizer·US

1mo ago

Scientist- Analytical Research and Development

Pfizer·US

1mo ago