Predict all classes

[sevinjyolchuyeva]

Predict all classes

[patil-suraj]

Hi @sevinjyolchuyeva , num_return_sequences is not the solution here. It's meant for generation but this problem is not purely generative. To get the probability of the class tokens, make sure each class label is encoded as single id. Then to get get probability you'll need to generate yourself without using the .generate method and get the final logits. Then let's say we are predicting "true" or "false", to get probability apply softmax only on the "true" and "false" tokens (in your case, 8 tokens).

Hope this helps. I'm not entirely sure how this will work, but worth giving it a try

[sevinjyolchuyeva]

Hi, @patil-suraj :),
Thank you so much for your comment. I have understood what you said. I will try it.