quoccuongle/grounding-dino
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

update tips

Browse Source
This commit is contained in:
SlongLiu
2023-04-12 18:40:11 +08:00
parent dbe0ad8f21
commit bd61f50091
1 changed files with 7 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
README.md
View File

@@ -57,12 +57,14 @@ Marrying <a href="https://github.com/IDEA-Research/GroundingDINO">Grounding DINO
<img src="https://huggingface.co/ShilongLiu/GroundingDINO/resolve/main/GD_GLIGEN.png" alt="gd_gligen" width="100%"> <img src="https://huggingface.co/ShilongLiu/GroundingDINO/resolve/main/GD_GLIGEN.png" alt="gd_gligen" width="100%">
</details> </details>
## :star: Explanation/Tips for Grounding DINO Inputs and Outputs ## :star: Explanations/Tips for Grounding DINO Inputs and Outputs
- Grounding DINO accepts with a `(image, text)` pair as inputs. - Grounding DINO accepts an `(image, text)` pair as inputs.
- It will outputs `900` (by default) object boxes. Each box has a similarity scores across all input words. - It outputs `900` (by default) object boxes. Each box has similarity scores across all input words. (as shown in Figures below.)
- We defaultly choose the boxes whose highest similarities are higher than a `box_threshold`. - We defaultly choose the boxes whose highest similarities are higher than a `box_threshold`.
- We clip the words whose similarities are higher than the `text_threshold` as predicted labels. - We extract the words whose similarities are higher than the `text_threshold` as predicted labels.
- If you want to obtain objects of certain phrases, like the `dogs` in the sentence `two dogs with a stick.`, you can select the boxes with highest text similarities with `dogs` as final outputs. - If you want to obtain objects of specific phrases, like the `dogs` in the sentence `two dogs with a stick.`, you can select the boxes with highest text similarities with `dogs` as final outputs.
- Note that each word can be split to **more than one** tokens with differetn tokenlizers. The number of words in a sentence may not equal to the number of text tokens.
- We suggest separating different category names with `.` for Grounding DINO.
![model_explain1](.asset/model_explan1.PNG) ![model_explain1](.asset/model_explan1.PNG)
![model_explain2](.asset/model_explan2.PNG) ![model_explain2](.asset/model_explan2.PNG)