What is the object query ?

[hitbuyi]

What is the object query ?

[sharmita01]

Object queries are the inputs to the decoder layer. They are randomly initialized and refined/learned through the training process. They can be initialized e.g., torch.rand(num_queries, hidden_dim). The learned object queries are passed to an FFN that predicts the class and bbox which are compared with the GT.

[KaiserW]

Thanks for your reply, I was wondering how an input could be learned? I thought the backpropagation only update weights while input values are intact. I'm new to Transformer-like algorithms and any advices would be appreciated.

[AjibolaPy]

Might be late to the party. I've gone true the code. The object query are embedding weights+ zero matrixes. My question/confusion is are they trainable since they are embedding weights?