[Question] Is this slated for release in the Transformers library?

[WAS-PlaiLabs]

[Question] Is this slated for release in the Transformers library?

[Luodian]

Hey! Yes, we would love to have it in the library 🤗

I am planning to work on it. Otherwise, @Luodian @ZhangYuanhan-AI let me know if you want to contribute it yourselves, I will be happy t help 😄

Hi we still have more release to be done and we are working hard for it. So can we wait for sometime, maybe next month, we can do this PR to update LLaVA-NeXT to huggingface transformers! Looking forward to doing it!

[zucchini-nlp]

Hey! Yes, we would love to have it in the library 🤗

I am planning to work on it. Otherwise, @Luodian @ZhangYuanhan-AI let me know if you want to contribute it yourselves, I will be happy t help 😄

[zucchini-nlp]

Great, will be looking forward for the next release. Let me know if you need any guidance for contributing a model 🤗

[Luodian]

yes, totally agree!

[zucchini-nlp]

@Luodian Hey again! Just wanted to check in and see if you had any updates on this. Thanks!

[Luodian]

@Luodian Hey again! Just wanted to check in and see if you had any updates on this. Thanks!

Hi! Thanks for your interests, we plan to focus on two or three weeks later (with more changes), is that a good time for you? or will break your progress. If so, before that, you could implement current llava-next-video. Then we could further contribute on it.

[zucchini-nlp]

@Luodian I see, thanks. Implementing the current state of "llava-next-video" sounds good for me. The model shows very good performance on videos, and we can give it more visibility on the hub by adding it to transformers

Also, if the new release is similar to current in terms of modeling/processing code, updating further will be easier and faster

[zucchini-nlp]

The model is added to Transformers and will be part of the next 4.42 release! Please find all checkpoints here: https://huggingface.co/collections/llava-hf/llava-next-video-6666a9173a64c7052930f153 🤗