Output with higher max_length is repetition of base text

[google]

Output with higher max_length is repetition of base text

[pengchongjin]

Could you please try the instruction-tuned model instead? It should give you better results.

[AbhishekJ24]

I am just happy to be a part of this chat

[azrael05]

Could you please try the instruction-tuned model instead? It should give you better results.

Thanks, With the instruct tuned model the output is perfect.

Btw is there any reason why the gemma_2b_en model produced repetitive output instead ks stopping ?.

[pengchongjin]

It's kind of expected that the pre-trained models only try to complete text. Maybe one way you could try is to tune the sampling parameters to see if you can get a bit diversity in the output.

[azrael05]

It's kind of expected that the pre-trained models only try to complete text. Maybe one way you could try is to tune the sampling parameters to see if you can get a bit diversity in the output.

Yeah, Its expected of it to complete the text but still shouldn't repeat its text right?
Example the other text generation models might produce half ending sentence outputs depending on the max_length size but they don't producr repeating ouputs.

[Ittiz]

I've noticed the 2b model repeating itself as well. Although, I found it does it when the context of my prompt would be hard even for a human to figure out.