Add interface for box prompt in SAM 2 video predictor (#174)

Browse Source

This PR adds an example to provide box prompt in SAM 2 as inputs to the `add_new_points_or_box` API (renamed from`add_new_points`, which is kept for backward compatibility). If `box` is provided, we add it as the first two points with labels 2 and 3, along with the user-provided points (consistent with how SAM 2 is trained).

The video predictor notebook `notebooks/video_predictor_example.ipynb` is updated to include segmenting from box prompt as an example.

...

This commit is contained in:

Ronghang Hu

2024-08-07 11:54:30 -07:00

committed by GitHub

parent 6ba4c65cb2

commit 6ecb5ff8d0

3 changed files with 451 additions and 89 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

480

notebooks/video_predictor_example.ipynb

File diff suppressed because one or more lines are too long