Hiring.Camp

Software Engineer, Perception

Relling

·

2 days ago

Salary
$120k – $170k/yr
Location
San Francisco, California, US
Type
Full-time
Department
Engineering
Experience
4+ years
Source
Y Combinator

Description

We're looking for a Robot Perception Engineer to develop the systems that give our robots a real-time understanding of the parts and workcells in front of them. You'll own the software that turns raw sensor data into the structured observations our controllers depend on, from camera integration and calibration through segmentation, tracking, and the 3D monitoring that lets our robots run alongside people.

What You'll Do

  • Develop and maintain real-time perception pipelines, integrating and calibrating cameras, depth sensors, and LiDAR with our robot platforms
  • Build segmentation, tracking, and pose estimation that holds up under part-to-part variation, deformable materials, and unreliable depth on thin or reflective features
  • Design the structured observation spaces our learned controllers consume, along with the labeling pipelines that make training them cheap
  • Own the 3D safety perception stack: occupancy prediction from point clouds, speed modulation, and protective stops that let our robots operate without fencing
  • Work with the controls and policy teams to connect perception outputs to policy inputs at control frequency
  • Support bring-up and field testing of new camera and sensor configurations on live production lines
  • Contribute to fault detection and recovery logic so the system survives an eight-hour shift

What We're Looking For

  • 4+ years of experience in robotics perception, computer vision, or a closely related field
  • Strong software engineering fundamentals in Python and C++
  • Hands-on experience with sensor integration and calibration (cameras, depth sensors, LiDAR, hand-eye)
  • Experience building real-time perception pipelines that ran on real hardware
  • Fluency with both learned and classical CV, and the judgment to know which one a problem calls for
  • Experience with ROS/ROS2 or similar robotics middleware
  • Ability to debug across the full stack, from driver-level sensor issues to model behavior on live hardware

Nice to Have (But Not Required)

  • Production experience with foundation-model perception (SAM2, DINOv2, open-vocabulary detectors), including where they break
  • Point cloud and 3D work: voxelization, occupancy networks, LiDAR processing
  • Manipulation background: visual servoing, imitation learning, ACT or diffusion policies
  • Sim-to-real experience, including domain randomization and sim/real co-training
  • Deploying and optimizing models on edge or onboard compute (quantization, TensorRT)
  • Exposure to safety standards for collaborative robotics (ISO/TS 15066, speed and separation monitoring, power and force limiting)
  • Prior work on early-stage hardware programs

Why This Role

  • Perception is the constraint. What our controllers can see sets the ceiling on what they can do, and the observation design you own moves task success more than the size of the model behind it.
  • You'll work at the boundary of hardware and AI on live production lines, where success is measured by a QC pass rate rather than a benchmark score.
  • High ownership on a small team. The decisions you make will shape how our robots perceive every site we deploy to.Motion Planning

Skills

PythonComputer Vision

Similar Jobs

30

Software Engineer, Perception

Hayden AI · San Francisco HQ Office · Hybrid

1 month ago

Software Engineer, Perception

Andurilindustries · Costa Mesa, California, United States

1 month ago

Software Engineer, Perception

Voxel · San Francisco, CA · Hybrid

1 month ago

Software Engineer, Perception

Intrinsicrobotics · Singapore

2 months ago

Software Engineer - Perception

Lodestarspace · San Francisco, US +1

10 months ago

Software Perception Engineer

Nauticus Robotics · Webster, TX, United States

1+ year ago

Senior Software Engineer, Perception Architecture

Stackav · Pittsburgh, PA or Remote · Remote

3 days ago

Senior Robot Platform Software Engineer, Perception Systems

Apptronik · Austin, TX

3 weeks ago

Senior Perception Software Engineer

Picklerobot · Charlestown, MA · Hybrid

1 month ago

Senior Software Engineer, Perception (Robotics)

Grab · Singapore, Singapore · Onsite

2 months ago

Senior/Staff Software Engineer - Perception & Sensing

Zoox · Foster City, CA +1 · Hybrid

2 months ago

Senior Software Engineer, Perception Architecture

Stackav · Pittsburgh, PA or Remote · Remote

2 months ago

Senior Software Engineer, Perception (Robotics)

Grab · Singapore, Singapore · Onsite

2 months ago

Senior Software Engineer, Perception Platform

Pathrobotics · Columbus, Ohio +1

2 months ago

Sr. Staff Software Engineer - Perception and Safety R&D

Bostondynamics · Waltham Office (POST), United States of America

2 months ago

Senior Software Engineer, Perception

Andurilindustries · Costa Mesa, California, United States

2 months ago

Senior Software Engineer, Perception (Robotics)

Grab · Singapore, Singapore · Onsite

2 months ago

Software Engineer - Perception / Mapping Data

Zoox · Foster City, CA · Hybrid

2 months ago

Robotic Software Engineer (Perception)

Ghost Robotics Corporation · HQ +1

2 months ago

Fullstack Software Engineer, Perception Experience

Intrinsicrobotics · Munich, Germany +1

2 months ago

Principal Software Engineer, Perception Architect

Zoox · Foster City, CA · Hybrid

2 months ago

Senior Software Engineer, Perception

Aerovect · Remote +11 · Remote

3 months ago

Perception Software Engineer - ADAS

Lucidmotors · Southfield, MI

3 months ago

Senior Staff Software Engineer, Perception

Aerovect · Remote +12 · Remote

3 months ago

Software Engineer - Perception / Fleet Mapping

Zoox · Foster City, CA +2 · Hybrid

3 months ago

Robotics Software Engineer (Perception & Localization)

RFS Group · San Francisco, CA

3 months ago

Senior Robotics Software Engineer - Perception & Localization

Rethink recruit

3 months ago

Robotic Software Engineer (Perception)

Ghost Robotics Corporation · Philadelphia, PA

4 months ago

Software Engineer - Perception (Fallback Stack)

Appliedintuition · Sunnyvale, California, United States · Remote, Onsite

4 months ago

Senior Robotics Software Engineer (Perception & Localization)

Orchard · San Francisco +1 · Onsite

4 months ago