Question: Is it SAM-HQ model applicable for predicting segmentation mask for the input images without boxes, point or label?

[mzg0108]

Question: Is it SAM-HQ model applicable for predicting segmentation mask for the input images without boxes, point or label?

[lkeab]

we can use the everything mode as demonstrated here, which input uniform sampled points on the images as prompt.

[jez-moxmo]

if I'm not mistaken, you need the prompt encoder to determine embeddings on an image to mask. automask generator actually is a bit misleading as it just generates a point prompt every 20 pixels or so. For each point prompt, embeddings are encoded and these are matched with the model on their IOU and the most probable (or top 3) is determined to be the masks.