Open-vocabulary perception on a Jetson Orin: what's your pipeline?

Grounding DINO for boxes followed by SAM 2.1 for masks is a common language-driven pick-and-place front end.

Did you export to TensorRT or stay in PyTorch, and what end-to-end rate did you get?

Referenced repos

Indexed from Hugging Face and linked upstream, not hosted here.

IDEA-Research/grounding-dino-tiny
Object detection172M paramsEst. Edge GPUApache 2.0Sep 2023

Open-vocabulary detector that draws boxes around objects named in a free-text prompt, without a fixed class list.

facebook/sam2.1-hiera-small
Segmentation46M paramsEst. Edge GPUApache 2.0Sep 2024

Compact variant of Meta's promptable segmentation model that returns object masks from points or boxes and can track them across video frames.

google/owlv2-base-patch16-ensemble
Object detection155M paramsEst. Edge GPUApache 2.0Oct 2023

CLIP-based zero-shot detector from Google that localizes objects from text queries or from an example image crop.

Comments

Sign-in with Hugging Face is live. Votes and comments are still saved only in this browser until shared threads ship.

Plain text. Saved only in this browser until shared threads ship.

No comments on this device yet.