camenduru/videocrafter-colab

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🍊 Jupyter Notebook

Notebook	Info
	VideoCrafter_Text2Video_colab
	VideoCrafter_Image2Video_colab (Pro Colab High-RAM 😐)
	VideoCrafter2_Text2Video_colab (Pro Colab High-RAM 😐)
	VideoCrafter2_kaggle (Free Kaggle)

Tutorial

Main Repo

https://github.com/AILab-CVC/VideoCrafter

Paper

https://arxiv.org/abs/2401.09047 (VideoCrafter2)
https://arxiv.org/abs/2310.19512 (VideoCrafter1)
https://arxiv.org/abs/2211.13221 (Base Model)

Page

https://ailab-cvc.github.io/videocrafter2
https://yingqinghe.github.io/LVDM/ (Base Model)

Model

https://huggingface.co/VideoCrafter/Image2Video-512-v1.0/tree/main
https://huggingface.co/VideoCrafter/Text2Video-1024-v1.0/tree/main

Output

(VideoCrafter2) prompt: an elephant is walking under the sea, 4K, high definition

an_elephant_is_walking_under_t.mp4

(VideoCrafter1) prompt: A tiger walks in the forest, photorealistic, 4k, high definition

0001.mp4

videocrafter-colab's Issues

High VRAM

It doesn't run the examples in colab due to high Vram usage, I guess there is nothing to do, just sayin!

Readme Asset

0001.mp4