Here we will keep track of the AI Game Development Tools, including LLM, Agent, Code, Writer, Image, Texture, Shader, 3D Model, Animation, Video, Audio, Music, Singing Voice and Analytics. 🔥
- Tool (AI LLM)
- Game (Agent)
- Code
- Framework
- Writer
- Image
- Texture
- Shader
- 3D Model
- Avatar
- Animation
- Visual
- Video
- Audio
- Music
- Singing Voice
- Speech
- Analytics
- Video Tool
Source | Description | Game Engine | Type |
---|---|---|---|
AgentGPT | 🤖 Assemble, configure, and deploy autonomous AI Agents in your browser. | Tool | |
AICommand | ChatGPT integration with Unity Editor. | Unity | Tool |
AIOS | LLM Agent Operating System. | Tool | |
Assistant CLI | A comfortable CLI tool to use ChatGPT service🔥 | Tool | |
Auto-GPT | An experimental open-source attempt to make GPT-4 fully autonomous. | Tool | |
BabyAGI | This Python script is an example of an AI-powered task management system. | Tool | |
👶🤖🖥️ BabyAGI UI | BabyAGI UI is designed to make it easier to run and develop with babyagi in a web app, like a ChatGPT. | Tool | |
baichuan-7B | A large-scale 7B pretraining language model developed by Baichuan. | Tool | |
Baichuan-13B | A 13B large language model developed by Baichuan Intelligent Technology. | Tool | |
Baichuan 2 | A series of large language models developed by Baichuan Intelligent Technology. | Tool | |
Character-LLM | A Trainable Agent for Role-Playing. | Tool | |
ChatDev | Communicative Agents for Software Development. | Tool | |
ChatGPT-API-unity | Binds ChatGPT chat completion API to pure C# on Unity. | Unity | Tool |
ChatGPTForUnity | ChatGPT for unity. | Unity | Tool |
ChatRWKV | ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source. | Tool | |
ChatYuan | Large Language Model for Dialogue in Chinese and English. | Tool | |
Chrome-GPT | An AutoGPT agent that controls Chrome on your desktop. | Tool | |
CogVLM | CogVLM, a powerful open-source visual language foundation model. | Tool | |
CoreNet | A library for training deep neural networks. | Tool | |
DBRX | DBRX is a large language model trained by Databricks. | Tool | |
DemoGPT | Auto Gen-AI App Generator with the Power of Llama 2 | Tool | |
Design2Code | Automating Front-End Engineering | Tool | |
Devika | Devika is an Agentic AI Software Engineer. | Tool | |
Dora | Generating powerful websites, one prompt at a time. | Tool | |
Flowise | Drag & drop UI to build your customized LLM flow using LangchainJS. | Tool | |
Gemini | Gemini is built from the ground up for multimodality — reasoning seamlessly across text, images, video, audio, and code. | Tool | |
Gemma | Gemma is a family of lightweight, state-of-the art open models built from research and technology used to create Google Gemini models. | Tool | |
gemma.cpp | lightweight, standalone C++ inference engine for Google's Gemma models. | Tool | |
GPT4All | A chatbot trained on a massive collection of clean assistant data including code, stories and dialogue. | Tool | |
GPTScript | Develop LLM Apps in Natural Language. | Tool | |
Grok-1 | The weights and architecture of our 314 billion parameter Mixture-of-Experts model, Grok-1. | Tool | |
HuggingChat | Making the community's best AI chat models available to everyone. | Tool | |
Hugging Face API Unity Integration | This Unity package provides an easy-to-use integration for the Hugging Face Inference API, allowing developers to access and use Hugging Face AI models within their Unity projects. | Unity | Tool |
ImageBind | ImageBind One Embedding Space to Bind Them All. | Tool | |
InteractML-Unity | InteractML, an Interactive Machine Learning Visual Scripting framework for Unity3D. | Unity | Tool |
InteractML-Unreal Engine | Bringing Machine Learning to Unreal Engine. | Unreal Engine | Tool |
InternLM | InternLM has open-sourced a 7 billion parameter base model, a chat model tailored for practical scenarios and the training system. | Tool | |
InternLM-XComposer | InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension. | Tool | |
Jan | Bring AI to your Desktop. | Tool | |
Lamini | Lamini allows any engineering team to outperform general purpose LLMs through RLHF and fine- tuning on their own data. | Tool | |
LaMini-LM | LaMini-LM is a collection of small-sized, efficient language models distilled from ChatGPT and trained on a large-scale dataset of 2.58M instructions. | Tool | |
LangChain | LangChain is a framework for developing applications powered by language models. | Tool | |
LangFlow | ⛓️ LangFlow is a UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows. | Tool | |
LaVague | Automate automation with Large Action Model framework. | Tool | |
Lemur | Open Foundation Models for Language Agents. | Tool | |
Lepton AI | A Pythonic framework to simplify AI service building. | Tool | |
Lit-LLaMA | Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. | Tool | |
llama2-webui | Run Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). | Tool | |
Llama 3 | The official Meta Llama 3 GitHub site. | Tool | |
LLaSM | Large Language and Speech Model. | Tool | |
LLM Answer Engine | Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Mixtral, Langchain, OpenAI, Brave & Serper. | Tool | |
llm.c | LLM training in simple, raw C/CUDA. | Tool | |
LLocalSearch | LLocalSearch is a completely locally running search engine using LLM Agents. | Tool | |
LogicGamesSolver | A Python tool to solve logic games with AI, Deep Learning and Computer Vision. | Tool | |
Large World Model (LWM) | Large World Model (LWM) is a general-purpose large-context multimodal autoregressive model. | Tool | |
MetaGPT | The Multi-Agent Framework | Tool | |
MiniCPM-2B | An end-side LLM outperforms Llama2-13B. | Tool | |
MiniGPT-4 | Enhancing Vision-language Understanding with Advanced Large Language Models. | Tool | |
MiniGPT-5 | Interleaved Vision-and-Language Generation via Generative Vokens. | Tool | |
Mixtral 8x7B | A high quality Sparse Mixture-of-Experts. | Tool | |
Mistral 7B | The best 7B model to date, Apache 2.0. | Tool | |
Mistral Large | Mistral Large is a new cutting-edge text generation model. It reaches top-tier reasoning capabilities. | Tool | |
MLC LLM | Enable everyone to develop, optimize and deploy AI models natively on everyone's devices. | Tool | |
MobiLlama | Towards Accurate and Lightweight Fully Transparent GPT. | Tool | |
MoE-LLaVA | Mixture of Experts for Large Vision-Language Models. | Tool | |
MOSS | An open-source tool-augmented conversational language model from Fudan University. | Tool | |
mPLUG-Owl🦉 | Modularization Empowers Large Language Models with Multimodality. | Tool | |
Nemotron-4 | A 15-billion-parameter large multilingual language model trained on 8 trillion text tokens. | Tool | |
NExT-GPT | Any-to-Any Multimodal Large Language Model. | Tool | |
OLMo | Open Language Model | Tool | |
OmniLMM | Large multi-modal models for strong performance and efficient deployment. | Tool | |
OneLLM | One Framework to Align All Modalities with Language. | Tool | |
Open-Assistant | OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so. | Tool | |
OpenDevin | An autonomous AI software engineer. | Tool | |
Orion-14B | Orion-14B is a family of models includes a 14B foundation LLM, and a series of models. | Tool | |
Panda | Overseas Chinese open source large language model, based on Llama-7B, -13B, -33B, -65B for continuous pre-training in the Chinese field. | Tool | |
Perplexica | An AI-powered search engine. | Tool | |
Pi | AI chatbot designed for personal assistance and emotional support. | Tool | |
Qwen1.5 | Qwen1.5 is the improved version of Qwen. | Tool | |
Qwen-7B | The official repo of Qwen-7B (通义千问-7B) chat & pretrained large language model proposed by Alibaba Cloud. | Tool | |
RepoAgent | RepoAgent is an Open-Source project driven by Large Language Models(LLMs) that aims to provide an intelligent way to document projects. | Tool | |
Sanity AI Engine | Sanity AI Engine for the Unity Game Development Tool. | Unity | Tool |
SearchGPT | 🌳 Connecting ChatGPT with the Internet | Tool | |
ShareGPT4V | Improving Large Multi-Modal Models with Better Captions. | Tool | |
Skywork | Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. | Tool | |
StableLM | Stability AI Language Models. | Tool | |
Stanford Alpaca | An Instruction-following LLaMA Model. | Tool | |
Text generation web UI | A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, OPT, and GALACTICA. | Tool | |
TinyChatEngine | On-Device LLM Inference Library. | Tool | |
ToolBench | An open platform for training, serving, and evaluating large language model for tool learning. | Tool | |
Unity ChatGPT | Unity ChatGPT Experiments. | Unity | Tool |
Unity OpenAI-API Integration | Integrate openai GPT-3 language model and ChatGPT API into a Unity project. | Unity | Tool |
Unreal Engine 5 Llama LoRA | A proof-of-concept project that showcases the potential for using small, locally trainable LLMs to create next-generation documentation tools. | Unreal Engine | Tool |
UnrealGPT | A collection of Unreal Engine 5 Editor Utility widgets powered by GPT3/4. | Unreal Engine | Tool |
Video-LLaVA | Learning United Visual Representation by Alignment Before Projection. | Tool | |
WebGPT | Run GPT model on the browser with WebGPU. | Tool | |
Web3-GPT | Deploy smart contracts with AI | Tool | |
WordGPT | 🤖 Bring the power of ChatGPT to Microsoft Word | Tool | |
XAgent | An Autonomous LLM Agent for Complex Task Solving. | Tool | |
Yi | A series of large language models trained from scratch by developers. | Tool | |
01 Project | The open-source language model computer. | Tool |
Source | Description | Game Engine | Type |
---|---|---|---|
AgentBench | A Comprehensive Benchmark to Evaluate LLMs as Agents. | Agent | |
Agent Group Chat | An Interactive Group Chat Simulacra For Better Eliciting Collective Emergent Behavior. | Agent | |
AgentScope | Start building LLM-empowered multi-agent applications in an easier way. | Agent | |
AgentSims | An Open-Source Sandbox for Large Language Model Evaluation. | Agent | |
AI Town | AI Town is a virtual town where AI characters live, chat and socialize. | Agent | |
anime.gf | Local & Open Source Alternative to CharacterAI. | Game | |
AutoAgents | A Framework for Automatic Agent Generation. | Agent | |
AutoGen | Enable Next-Gen Large Language Model Applications. | Agent | |
Biomes | Biomes is an open source sandbox MMORPG built for the web using web technologies such as Next.js, Typescript, React and WebAssembly. | Game | |
Byzer-Agent | Easy, fast, and distributed agent framework for everyone. | Agent | |
Cat Town | A C(h)atGPT-powered simulation with cats. | Agent | |
Cat Town | A C(h)atGPT-powered simulation with cats. | Agent | |
CharacterGLM | Customizing Chinese Conversational AI Characters with Large Language Models. | Agent | |
ChatDev | Communicative Agents for Software Development. | Agent | |
CogAgent | CogAgent is an open-source visual language model improved based on CogVLM. | Agent | |
Cradle | Towards General Computer Control. | Agent | |
crewAI | Framework for orchestrating role-playing, autonomous AI agents. | Agent | |
Dify | Dify is an open-source LLM app building platform. | Agent | |
Digital Life Project | Autonomous 3D Characters with Social Intelligence. | Agent | |
fabric | fabric is an open-source framework for augmenting humans using AI. | Agent | |
FastGPT | FastGPT is a knowledge-based platform built on the LLM. | Agent | |
fastRAG | Efficient Retrieval Augmentation and Generation Framework. | Agent | |
Generative Agents | Interactive Simulacra of Human Behavior. | Agent | |
Genie | Generative Interactive Environments. | Game | |
gigax | Runtime, LLM-powered NPCs. | Game | |
Interactive LLM Powered NPCs | Interactive LLM Powered NPCs, is an open-source project that completely transforms your interaction with non-player characters (NPCs) in any game! | Game | |
KwaiAgents | A generalized information-seeking agent system with Large Language Models (LLMs). | Agent | |
LangChain | Get your LLM application from prototype to production. | Agent | |
Langflow | Langflow is a UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows. | Agent | |
LARP | Language-Agent Role Play for open-world games. | Agent | |
LlamaIndex | LlamaIndex is a data framework for your LLM application. | Agent | |
MuG Diffusion | MuG Diffusion is a charting AI for rhythm games based on Stable Diffusion (one of the most powerful AIGC models) with a large modification to incorporate audio waves. | Game | |
OpenAgents | An Open Platform for Language Agents in the Wild. | Agent | |
Opus | An AI app that turns text into a video game. | Game | |
Qwen-Agent | Qwen-Agent is a framework for developing LLM applications based on the instruction following, tool usage, planning, and memory capabilities of Qwen. | Agent | |
Ragas | Ragas is a framework that helps you evaluate your Retrieval Augmented Generation (RAG) pipelines. | Agent | |
SIMA | A generalist AI agent for 3D virtual environments. | Agent | |
StoryGames.ai | AI for Dreamers Make Games. | Game | |
SWE-agent | Agent Computer Interfaces Enable Software Engineering Language Models. | Agent | |
Video2Game | Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video. | Game | |
V-IRL | Grounding Virtual Intelligence in Real Life. | Agent | |
XAgent | An Autonomous LLM Agent for Complex Task Solving. | Agent |
Source | Description | Game Engine | Type |
---|---|---|---|
AI Code Translator | Use AI to translate code from one language to another. | Code | |
aiXcoder-7B | aiXcoder-7B Code Large Language Model. | Code | |
bloop | bloop is a fast code search engine written in Rust. | Code | |
Chapyter | ChatGPT Code Interpreter in Jupyter Notebooks. | Code | |
CodeGeeX | An Open Multilingual Code Generation Model. | Code | |
CodeGeeX2 | A More Powerful Multilingual Code Generation Model. | Code | |
CodeGen | CodeGen is an open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex. | Code | |
CodeGen2 | CodeGen2 models for program synthesis. | Code | |
Code Llama | Code Llama is a large language models for code based on Llama 2. | Code | |
CodeTF | One-stop Transformer Library for State-of-the-art Code LLM. | Code | |
CodeT5 | Open Code LLMs for Code Understanding and Generation. | Code | |
Cursor | Write, edit, and chat about your code with GPT-4 in a new type of editor. | Code | |
OpenAI Codex | OpenAI Codex is a descendant of GPT-3. | Code | |
PandasAI | Pandas AI is a Python library that integrates generative artificial intelligence capabilities into Pandas, making dataframes conversational. | Code | |
RobloxScripterAI | RobloxScripterAI is an AI-powered code generation tool for Roblox. | Roblox | Code |
Scikit-LLM | Seamlessly integrate powerful language models like ChatGPT into scikit-learn for enhanced text analysis tasks. | Code | |
SoTaNa | The Open-Source Software Development Assistant. | Code | |
Stable Code 3B | Coding on the Edge. | Code | |
StarCoder | 💫 StarCoder is a language model (LM) trained on source code and natural language text. | Code | |
StarCoder 2 | StarCoder2 is a family of code generation models (3B, 7B, and 15B), trained on 600+ programming languages from The Stack v2 and some natural language text such as Wikipedia, Arxiv, and GitHub issues. | Code | |
UnityGen AI | UnityGen AI is an AI-powered code generation plugin for Unity. | Unity | Code |
Source | Description | Game Engine | Type |
---|---|---|---|
behaviac | Behaviac is a framework of the game AI development. | Framework | |
GameAISDK | Image-based game AI automation framework. | Framework | |
Moonlander.ai | Start building 3D games without any coding using generative AI. | Framework |
Source | Description | Game Engine | Type |
---|---|---|---|
AI-Writer | AI writes novels, generates fantasy and romance web articles, etc. Chinese pre-trained generative model. | Writer | |
Notebook.ai | Notebook.ai is a set of tools for writers, game designers, and roleplayers to create magnificent universes – and everything within them. | Writer | |
Novel | Notion-style WYSIWYG editor with AI-powered autocompletions. | Writer | |
NovelAI | Driven by AI, painlessly construct unique stories, thrilling tales, seductive romances, or just fool around. | Writer |
Source | Description | Game Engine | Type |
---|---|---|---|
AnyDoor | Zero-shot Object-level Image Customization. | Image | |
AnyText | Multilingual Visual Text Generation And Editing. | Image | |
Blender-ControlNet | Using ControlNet right in Blender. | Blender | Image |
BriVL | Bridging Vision and Language Model. | Image | |
CLIPasso | A method for converting an image of an object to a sketch, allowing for varying levels of abstraction. | Image | |
ClipDrop | Create stunning visuals in seconds. | Image | |
ComfyUI | A powerful and modular stable diffusion GUI with a graph/nodes interface. | Image | |
ConceptLab | Creative Generation using Diffusion Prior Constraints. | Image | |
ControlNet | ControlNet is a neural network structure to control diffusion models by adding extra conditions. | Image | |
DALL·E 2 | DALL·E 2 is an AI system that can create realistic images and art from a description in natural language. | Image | |
Dashtoon Studio | Dashtoon Studio is an AI powered comic creation platform. | Comic | |
DeepAI | DeepAI offers a suite of tools that use AI to enhance your creativity. | Image | |
DeepFloyd IF | IF by DeepFloyd Lab at StabilityAI. | Image | |
Depth map library and poser | Depth map library for use with the Control Net extension for Automatic1111/stable-diffusion-webui. | Image | |
Diffuse to Choose | Enriching Image Conditioned Inpainting in Latent Diffusion Models for Virtual Try-All. | Image | |
Disco Diffusion | A frankensteinian amalgamation of notebooks, models and techniques for the generation of AI Art and Animations. | Image | |
DragGAN | Interactive Point-based Manipulation on the Generative Image Manifold. | Image | |
Draw Things | AI- assisted image generation in Your Pocket. | Image | |
DWPose | Effective Whole-body Pose Estimation with Two-stages Distillation. | Image | |
EasyPhoto | Your Smart AI Photo Generator. | Image | |
Follow-Your-Click | Open-domain Regional Image Animation via Short Prompts. | Image | |
Fooocus | Focus on prompting and generating. | Image | |
GIFfusion | Create GIFs and Videos using Stable Diffusion. | Image | |
Grounded-Segment-Anything | Automatically Detect , Segment and Generate Anything with Image, Text, and Audio Inputs. | Image | |
Hua | Hua is an AI image editor with Stable Diffusion (and more). | Image | |
Ideogram | Helping people become more creative. | Image | |
Imagen | Imagen is an AI system that creates photorealistic images from input text. | Image | |
img2img-turbo | One-Step Image-to-Image with SD-Turbo. | Image | |
Img2Prompt | Get prompts from stable diffusion generated images. | Image | |
InstantID | Zero-shot Identity-Preserving Generation in Seconds. | Image | |
InternLM-XComposer2 | InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension. | Image | |
KOALA | Self-Attention Matters in Knowledge Distillation of Latent Diffusion Models for Memory-Efficient and Fast Image Synthesis. | Image | |
KREA | Generate images and videos with a delightful AI-powered design tool. | Image | |
LaVi-Bridge | Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation. | Image | |
LayerDiffusion | Transparent Image Layer Diffusion using Latent Transparency. | Image | |
Lexica | A Stable Diffusion prompts search engine. | Image | |
MetaShoot | MetaShoot is a digital twin of a photo studio, developed as a plugin for Unreal Engine that gives any creator the ability to produce highly realistic renders in the easiest and quickest way. | Unreal Engine | Image |
Midjourney | Midjourney is an independent research lab exploring new mediums of thought and expanding the imaginative powers of the human species. | Image | |
Openpose Editor | Openpose Editor for AUTOMATIC1111's stable-diffusion-webui. | Image | |
Outfit Anyone | Ultra-high quality virtual try-on for Any Clothing and Any Person. | Image | |
PhotoMaker | Customizing Realistic Human Photos via Stacked ID Embedding. | Image | |
Photoroom | AI Background Generator. | Image | |
Plask | AI image generation in the cloud. | Image | |
Prompt.Art | The Generators Hub. | Image | |
Rich-Text-to-Image | Expressive Text-to-Image Generation with Rich Text. | Image | |
RPG-DiffusionMaster | Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs (PRG). | Image | |
Segment Anything | Segment Anything Model (SAM): a new AI model from Meta AI that can "cut out" any object , in any image , with a single click. | Image | |
sd-webui-controlnet | WebUI extension for ControlNet. | Image | |
SDXL-Lightning | Progressive Adversarial Diffusion Distillation. | Image | |
SDXS | Real-Time One-Step Latent Diffusion Models with Image Conditions. | Image | |
Stable.art | Photoshop plugin for Stable Diffusion with Automatic1111 as backend (locally or with Google Colab). | Image | |
Stable Cascade | Stable Cascade consists of three models: Stage A, Stage B and Stage C, representing a cascade for generating images, hence the name "Stable Cascade". | Image | |
Stable Diffusion | A latent text-to-image diffusion model. | Image | |
stable-diffusion.cpp | Stable Diffusion in pure C/C++. | Image | |
Stable Diffusion web UI | A browser interface based on Gradio library for Stable Diffusion. | Image | |
Stable Diffusion web UI | Web-based UI for Stable Diffusion. | Image | |
Stable Diffusion WebUI Chinese | Chinese version of stable-diffusion-webui. | Image | |
Stable Diffusion XL | Generate images from text. | Image | |
Stable Diffusion XL Turbo | Real-Time Text-to-Image Generation. | Image | |
Stable Doodle | Stable Doodle is a sketch-to-image tool that converts a simple drawing into a dynamic image. | Image | |
StableStudio | StableStudio by Stability AI | Image | |
StreamDiffusion | A Pipeline-Level Solution for Real-Time Interactive Generation. | Image | |
StyleDrop | Text-To-Image Generation in Any Style. | Image | |
SyncDreamer | Generating Multiview-consistent Images from a Single-view Image. | Image | |
Unity ML Stable Diffusion | Core ML Stable Diffusion on Unity. | Unity | Image |
Vispunk Visions | Text-to-Image generation platform. | Image |
Source | Description | Game Engine | Type |
---|---|---|---|
CRM | Single Image to 3D Textured Mesh with Convolutional Reconstruction Model. | Texture | |
DreamSpace | Dreaming Your Room Space with Text-Driven Panoramic Texture Propagation. | Texture | |
Dream Textures | Stable Diffusion built-in to Blender. Create textures, concept art, background assets, and more with a simple text prompt. | Blender | Texture |
InstructHumans | Editing Animated 3D Human Textures with Instructions. | Texture | |
InteX | Interactive Text-to-Texture Synthesis via Unified Depth-aware Inpainting. | Texture | |
Neuralangelo | High-Fidelity Neural Surface Reconstruction. | Texture | |
Paint-it | Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Rendering. | Texture | |
Polycam | Create your own 3D textures just by typing. | Texture | |
TexFusion | Synthesizing 3D Textures with Text-Guided Image Diffusion Models. | Texture | |
Text2Tex | Text-driven texture Synthesis via Diffusion Models. | Texture | |
Texture Lab | AI-generated texures. You can generate your own with a text prompt. | Texture | |
With Poly | Create Textures With Poly. Generate 3D materials with AI in a free online editor, or search our growing community library. | Texture |
Source | Description | Game Engine | Type |
---|---|---|---|
AI Shader | ChatGPT-powered shader generator for Unity. | Unity | Shader |
Source | Description | Game Engine | Type |
---|---|---|---|
Anything-3D | Segment-Anything + 3D. Let's lift the anything to 3D. | Model | |
BlenderGPT | Use commands in English to control Blender with OpenAI's GPT-4. | Blender | Model |
Blender-GPT | An all-in-one Blender assistant powered by GPT3/4 + Whisper integration. | Blender | Model |
Blockade Labs | Digital alchemy is real with Skybox Lab - the ultimate AI-powered solution for generating incredible 360° skybox experiences from text prompts. | Model | |
chatGPT-maya | Simple Maya tool that utilizes open AI to perform basic tasks based on descriptive instructions. | Maya | Model |
CityDreamer | Compositional Generative Model of Unbounded 3D Cities. | 3D | |
CSM | Generate 3D worlds from images and videos. | 3D | |
Dash | Your Copilot for World Building in Unreal Engine. | Unreal Engine | 3D |
DUSt3R | Geometric 3D Vision Made Easy. | 3D | |
GaussianDreamer | Fast Generation from Text to 3D Gaussian Splatting with Point Cloud Priors. | 3D | |
GenieLabs | Empower your game with AI-UGC. | 3D | |
HiFA | High-fidelity Text-to-3D with advance Diffusion guidance. | Model | |
Infinigen | Infinite Photorealistic Worlds using Procedural Generation. | 3D | |
Instruct-NeRF2NeRF | Editing 3D Scenes with Instructions. | Model | |
Interactive3D | Create What You Want by Interactive 3D Generation. | 3D | |
Isotropic3D | Image-to-3D Generation Based on a Single CLIP Embedding. | 3D | |
LATTE3D | Large-scale Amortized Text-To-Enhanced3D Synthesis. | 3D | |
LION | Latent Point Diffusion Models for 3D Shape Generation. | Model | |
Luma AI | Capture in lifelike 3D. Unmatched photorealism, reflections, and details. The future of VFX is now, for everyone! | Model | |
lumine AI | AI-Powered Creativity. | 3D | |
Make-It-3D | High-Fidelity 3D Creation from A Single Image with Diffusion Prior. | Model | |
Meshy | Create Stunning 3D Game Assets with AI. | 3D | |
Mootion | Magical 3D AI Animation Maker. | 3D | |
MVDream | Multi-view Diffusion for 3D Generation. | 3D | |
NVIDIA Instant NeRF | Instant neural graphics primitives: lightning fast NeRF and more. | Model | |
One-2-3-45 | Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization. | Model | |
Paint3D | Paint Anything 3D with Lighting-Less Texture Diffusion Models. | 3D | |
PAniC-3D | Stylized Single-view 3D Reconstruction from Portraits of Anime Characters. | Model | |
Point·E | Point cloud diffusion for 3D model synthesis. | Model | |
ProlificDreamer | High-Fidelity and diverse Text-to-3D generation with Variational score Distillation. | Model | |
Shap-E | Generate 3D objects conditioned on text or images. | Model | |
Sloyd | 3D modelling has never been easier. | Model | |
Spline AI | The power of AI is coming to the 3rd dimension. Generate objects, animations, and textures using prompts. | Model | |
Stable Dreamfusion | A pytorch implementation of the text-to-3D model Dreamfusion, powered by the Stable Diffusion text-to-2D model. | Model | |
SV3D | Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion. | 3D | |
Tafi | AI text to 3D character engine. | Model | |
3D-GPT | Procedural 3D MODELING WITH LARGE LANGUAGE MODELS. | 3D | |
3D-LLM | Injecting the 3D World into Large Language Models. | 3D | |
3Dpresso | Extract a 3D model of an object, captured on a video. | Model | |
3DTopia | Text-to-3D Generation within 5 Minutes. | 3D | |
threestudio | A unified framework for 3D content generation. | Model | |
TripoSR | A state-of-the-art open-source model for fast feedforward 3D reconstruction from a single image. | Model | |
UnityGaussianSplatting | Toy Gaussian Splatting visualization in Unity. | Unity | 3D |
ViVid-1-to-3 | Novel View Synthesis with Video Diffusion Models. | 3D | |
Voxcraft | Crafting Ready-to-Use 3D Models with AI. | 3D | |
Wonder3D | Single Image to 3D using Cross-Domain Diffusion. | 3D | |
Zero-1-to-3 | Zero-shot One Image to 3D Object. | Model |
Source | Description | Game Engine | Type |
---|---|---|---|
AniPortrait | Audio-Driven Synthesis of Photorealistic Portrait Animations. | Avatar | |
CALM | Conditional Adversarial Latent Models for Directable Virtual Characters. | Avatar | |
ChatAvatar | Progressive generation Of Animatable 3D Faces Under Text guidance. | Avatar | |
ChatdollKit | ChatdollKit enables you to make your 3D model into a chatbot. | Unity | Avatar |
DreamTalk | When Expressive Talking Head Generation Meets Diffusion Probabilistic Models. | Avatar | |
GeneAvatar | Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image. | Avatar | |
GeneFace++ | Generalized and Stable Real-Time 3D Talking Face Generation. | Avatar | |
HeadSculpt | Crafting 3D Head Avatars with Text. | Avatar | |
Linly-Talker | Digital Avatar Conversational System. | Avatar | |
MotionGPT | Human Motion as a Foreign Language, a unified motion-language generation model using LLMs. | Avatar | |
MuseTalk | Real-Time High Quality Lip Synchorization with Latent Space Inpainting. | Avatar | |
Ready Player Me | Integrate customizable avatars into your game or app in days. | Avatar | |
StyleAvatar3D | Leveraging Image-Text Diffusion Models for High-Fidelity 3D Avatar Generation. | Avatar | |
Text2Control3D | Controllable 3D Avatar Generation in Neural Radiance Fields using Geometry-Guided Text-to-Image Diffusion Model. | Avatar | |
UnityAIWithChatGPT | Based on Unity, ChatGPT+UnityChan voice interactive display is realized. | Unity | Avatar |
Vid2Avatar | 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition. | Avatar | |
VLOGGER | Multimodal Diffusion for Embodied Avatar Synthesis. | Avatar | |
Wild2Avatar | Rendering Humans Behind Occlusions. | Avatar |
Source | Description | Game Engine | Type |
---|---|---|---|
Animate Anyone | Consistent and Controllable Image-to-Video Synthesis for Character Animation. | Animation | |
AnimateAnything | Fine-Grained Open Domain Image Animation with Motion Guidance. | Animation | |
AnimateDiff | Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning. | Animation | |
AnimateLCM | Let's Accelerate the Video Generation within 4 Steps! | Animation | |
AnimateZero | Video Diffusion Models are Zero-Shot Image Animators. | Animation | |
AnimationGPT | An AIGC tool for generating game combat motion assets. | Animation | |
Deforum | Deforum leverages Stable Diffusion to generate evolving AI visuals. | Animation | |
DreaMoving | A Human Video Generation Framework based on Diffusion Models. | Animation | |
FaceFusion | Next generation face swapper and enhancer. | Animation | |
FreeInit | Bridging Initialization Gap in Video Diffusion Models. | Animation | |
GeneFace | Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis. | Animation | |
MagicAnimate | Temporally Consistent Human Image Animation using Diffusion Model. | Animation | |
NUWA | DragNUWA is an open-domain diffusion-based video generation model takes text, image, and trajectory controls as inputs to achieve controllable video generation. | Animation | |
NUWA-Infinity | NUWA-Infinity is a multimodal generative model that is designed to generate high-quality images and videos from given text, image or video input. | Animation | |
NUWA-XL | A novel Diffusion over Diffusion architecture for eXtremely Long video generation. | Animation | |
Omni Animation | AI Generated High Fidelity Animations. | Animation | |
PIA | Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Models. | Animation | |
SadTalker | Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation. | Animation | |
SadTalker-Video-Lip-Sync | This project is based on SadTalkers Wav2lip for video lip synthesis. | Animation | |
Stable Animation | A powerful text-to-animation tool for developers. | Animation | |
TaleCrafter | An interactive story visualization tool that support multiple characters. | Animation | |
Wav2Lip | Accurately Lip-syncing Videos In The Wild. | Animation | |
Wonder Studio | An AI tool that automatically animates, lights and composes CG characters into a live-action scene. | Animation |
Source | Description | Game Engine | Type |
---|---|---|---|
LLaVA++ | Extending Visual Capabilities with LLaMA-3 and Phi-3. | Visual | |
PLLaVA | Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning. | Visual | |
Vitron | A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing. | Visual |
Source | Description | Game Engine | Type |
---|---|---|---|
360DVD | Controllable Panorama Video Generation with 360-Degree Video Diffusion Model. | Video | |
Animate-A-Story | Retrieval-Augmented Video Generation for Telling a Story. | Video | |
Anything in Any Scene | Photorealistic Video Object Insertion. | Video | |
ART•V | Auto-Regressive Text-to-Video Generation with Diffusion Models. | Video | |
Assistive | Meet the generative video platform that brings your ideas to life. | Video | |
AtomoVideo | High Fidelity Image-to-Video Generation. | Video | |
BackgroundRemover | Background Remover lets you Remove Background from images and video using AI with a simple command line interface that is free and open source. | Video | |
Boximator | Generating Rich and Controllable Motions for Video Synthesis. | Video | |
CoDeF | Content Deformation Fields for Temporally Consistent Video Processing. | Video | |
CogVideo | Generate Videos from Text Descriptions. | Video | |
CogVLM | CogVLM is a powerful open-source visual language model (VLM). | Visual | |
CoNR | Genarate vivid dancing videos from hand-drawn anime character sheets(ACS). | Video | |
Decohere | Create what can't be filmed. | Video | |
Descript | Descript is the simple, powerful , and fun way to edit. | Video | |
dolphin | General video interaction platform based on LLMs. | Video | |
DomoAI | Amplify Your Creativity with DomoAI. | Video | |
DynamiCrafter | Animating Open-domain Images with Video Diffusion Priors. | Video | |
EDGE | We introduce EDGE, a powerful method for editable dance generation that is capable of creating realistic, physically-plausible dances while remaining faithful to arbitrary input music. | Video | |
EMO | Emote Portrait Alive - Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions. | Video | |
Emu Video | Factorizing Text-to-Video Generation by Explicit Image Conditioning. | Video | |
Etna | Etna can generate corresponding video content based on short text descriptions. | Video | |
Fairy | Fast Parallelized Instruction-Guided Video-to-Video Synthesis. | Video | |
Follow Your Pose | Pose-Guided Text-to-Video Generation using Pose-Free Videos. | Video | |
FullJourney | Your complete suite of AI Creation tools at your fingertips. | Video | |
Gen-2 | A multi-modal AI system that can generate novel videos with text, images, or video clips. | Video | |
Generative Dynamics | Generative Image Dynamics. | Video | |
Genie | Generative Interactive Environments. | Video | |
Genmo | Magically make videos with AI. | Video | |
GenTron | Diffusion Transformers for Image and Video Generation. | Video | |
HiGen | Hierarchical Spatio-temporal Decoupling for Text-to-Video generation. | Video | |
Hotshot-XL | Hotshot-XL is an AI text-to-GIF model trained to work alongside Stable Diffusion XL. | Video | |
Imagen Video | Given a text prompt, Imagen Video generates high definition videos using a base video generation model and a sequence of interleaved spatial and temporal video super-resolution models. | Video | |
InstructVideo | Instructing Video Diffusion Models with Human Feedback. | Video | |
I2VGen-XL | High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models. | Video | |
LaVie | High-Quality Video Generation with Cascaded Latent Diffusion Models. | Video | |
LTX Studio | LTX Studio is a holistic, AI-driven filmmaking platform for creators, marketers, filmmakers and studios. | Video | |
Lumiere | A Space-Time Diffusion Model for Video Generation. | Video | |
LVDM | Latent Video Diffusion Models for High-Fidelity Long Video Generation. | Video | |
MagicVideo | Efficient Video Generation With Latent Diffusion Models. | Video | |
MagicVideo-V2 | Multi-Stage High-Aesthetic Video Generation. | Video | |
Magic Hour | AI Video for Creators made simple. | Video | |
MAGVIT-v2 | Tokenizer is key to visual generation. | Video | |
MAGVIT | Masked Generative Video Transformer. | Video | |
Make-A-Video | Make-A-Video is a state-of-the-art AI system that generates videos from text. | Video | |
Make Pixels Dance | High-Dynamic Video Generation. | Video | |
Make-Your-Video | Customized Video Generation Using Textual and Structural Guidance. | Video | |
MicroCinema | A Divide-and-Conquer Approach for Text-to-Video Generation. | Video | |
Mini-Gemini | Mining the Potential of Multi-modality Vision Language Models. | Vision | |
MobileVidFactory | Automatic Diffusion-Based Social Media Video Generation for Mobile Devices from Text. | Video | |
MoneyPrinterTurbo | Use large models to generate short videos with one click. | Video | |
Moonvalley | Moonvalley is a groundbreaking new text-to-video generative AI model. | Video | |
Mora | More like Sora for Generalist Video Generation. | Video | |
Morph Studio | With our Text-to-Video AI Magic, manifest your creativity through your prompt. | Video | |
MotionCtrl | A Unified and Flexible Motion Controller for Video Generation. | Video | |
MotionDirector | Motion Customization of Text-to-Video Diffusion Models. | Video | |
Motionshop | An application of replacing the characters in video with 3D avatars. | Video | |
Mov2mov | Mov2mov plugin for Automatic1111/stable-diffusion-webui. | Video | |
MovieFactory | Automatic Movie Creation from Text using Large Generative Models for Language and Images. | Video | |
Neural Frames | Discover the synthesizer for the visual world. | Video | |
NeverEnds | Create your world. | Video | |
Open-Sora | Democratizing Efficient Video Production for All. | Video | |
Open-Sora | Open-Sora Plan. | Video | |
Phenaki | A model for generating videos from text, with prompts that can change over time, and videos that can be as long as multiple minutes. | Video | |
Pika Labs | Pika Labs is revolutionizing video-making experience with AI. | Video | |
Pixeling | Pixeling empowers our customers to create highly precise, ultra-realistic, and extremely controllable visual content including images, videos and 3D models. | Video | |
PixVerse | Create breath-taking videos with AI. | Video | |
Pollinations | Creating gets easy, fast, and fun. | Video | |
Reuse and Diffuse | Iterative Denoising for Text-to-Video Generation. | Video | |
ShortGPT | An experimental AI framework for automated short/video content creation. | Video | |
Show-1 | Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation. | Video | |
Snap Video | Scaled Spatiotemporal Transformers for Text-to-Video Synthesis. | Video | |
Sora | Creating video from text. | Video | |
SoraWebui | SoraWebui is an open-source Sora web client, enabling users to easily create videos from text with OpenAI's Sora model. | Video | |
StableVideo | Text-driven Consistency-aware Diffusion Video Editing. | Video | |
Stable Video Diffusion | Stable Video Diffusion (SVD) Image-to-Video. | Video | |
StreamingT2V | Consistent, Dynamic, and Extendable Long Video Generation from Text. | Video | |
StyleCrafter | nhancing Stylized Text-to-Video Generation with Style Adapter. | Video | |
TATS | Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer. | Video | |
Text2Video-Zero | Text-to-Image Diffusion Models are Zero-Shot Video Generators. | Video | |
TF-T2V | A Recipe for Scaling up Text-to-Video Generation with Text-free Videos. | Video | |
Track-Anything | Track-Anything is a flexible and interactive tool for video object tracking and segmentation, based on Segment Anything and XMem. | Video | |
Tune-A-Video | One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation. | Video | |
TwelveLabs | Multimodal AI that understands videos like humans. | Video | |
UniVG | Towards UNIfied-modal Video Generation. | Video | |
VGen | A holistic video generation ecosystem for video generation building on diffusion models. | Video | |
Video-ChatGPT | Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. | Video | |
VideoComposer | Compositional Video Synthesis with Motion Controllability. | Video | |
VideoCrafter1 | Open Diffusion Models for High-Quality Video Generation. | Video | |
VideoCrafter2 | Overcoming Data Limitations for High-Quality Video Diffusion Models. | Video | |
VideoDrafter | Content-Consistent Multi-Scene Video Generation with LLM. | Video | |
VideoElevator | Elevating Video Generation Quality with Versatile Text-to-Image Diffusion Models. | Video | |
VideoFactory | Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generation. | Video | |
VideoGen | A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generation. | Video | |
VideoLCM | Video Latent Consistency Model. | Video | |
Video LDMs | Align your Latents: High- resolution Video Synthesis with Latent Diffusion Models. | Video | |
Video-LLaVA | Learning United Visual Representation by Alignment Before Projection. | Video | |
VideoMamba | State Space Model for Efficient Video Understanding. | Video | |
VideoPoet | A large language model for zero-shot video generation. | Video | |
Vispunk Motion | Create realistic videos using just text. | Video | |
VisualRWKV | VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks. | Visual | |
V-JEPA | Video Joint Embedding Predictive Architecture. | Video | |
W.A.L.T | Photorealistic Video Generation with Diffusion Models. | Video | |
Zeroscope | Zeroscope Text-to-Video. | Video |
Source | Description | Game Engine | Type |
---|---|---|---|
AcademiCodec | An Open Source Audio Codec Model for Academic Research. | Audio | |
Amphion | An Open-Source Audio, Music, and Speech Generation Toolkit. | Audio | |
ArchiSound | Audio generation using diffusion models, in PyTorch. | Audio | |
Audiobox | Unified Audio Generation with Natural Language Prompts. | Audio | |
AudioEditing | Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversion. | Audio | |
Audiogen Codec | A low compression 48khz stereo neural audio codec for general audio, optimizing for audio fidelity 🎵. | Audio | |
AudioGPT | Understanding and Generating Speech, Music, Sound, and Talking Head. | Audio | |
AudioLDM | Text-to-Audio Generation with Latent Diffusion Models. | Audio | |
AudioLDM 2 | Learning Holistic Audio Generation with Self-supervised Pretraining. | Audio | |
Auffusion | Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generation. | Audio | |
CTAG | Creative Text-to-Audio Generation via Synthesizer Programming. | Audio | |
MAGNeT | Masked Audio Generation using a Single Non-Autoregressive Transformer. | Audio | |
Make-An-Audio | Text-To-Audio Generation with Prompt-Enhanced Diffusion Models. | Audio | |
NeuralSound | Learning-based Modal Sound Synthesis with Acoustic Transfer. | Audio | |
OptimizerAI | Sounds for Creators, Game makers, Artists, Video makers. | Audio | |
SoundStorm | Efficient Parallel Audio Generation. | Audio | |
Stable Audio | Fast Timing-Conditioned Latent Audio Diffusion. | Audio | |
TANGO | Text-to-Audio Generation using Instruction Tuned LLM and Latent Diffusion Model. | Audio | |
WavJourney | Compositional Audio Creation with Large Language Models. | Audio |
Source | Description | Game Engine | Type |
---|---|---|---|
AIVA | The Artificial Intelligence composing emotional soundtrack music. | Music | |
Amper Music | Custom music generation technology powered by Amper. | Music | |
Boomy | Create generative music. Share it with the world. | Music | |
ChatMusician | Fostering Intrinsic Musical Abilities Into LLM. | Music | |
Chord2Melody | Automatic Music Generation AI. | Music | |
GPTAbleton | Draft script for processing GPT response and sending the MIDI notes into the Ableton clips with AbletonOSC and python-osc. | Music | |
Image to Music | AI Image to Music Generator is a tool that uses artificial intelligence to convert images into music. | Music | |
JEN-1 | Text-Guided Universal Music Generation with Omnidirectional Diffusion Models. | Music | |
Jukebox | A Generative Model for Music. | Music | |
Magenta | Magenta is a research project exploring the role of machine learning in the process of creating art and music. | Music | |
MeLoDy | Efficient Neural Music Generation | Music | |
Mubert | AI Generative Music. | Music | |
MuseNet | A deep neural network that can generate 4-minute musical compositions with 10 different instruments, and can combine styles from country to Mozart to the Beatles. | Music | |
MusicGen | Simple and Controllable Music Generation. | Music | |
MusicLDM | Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategies. | Music | |
MusicLM | Generating Music From Text. | Music | |
Riffusion App | Riffusion is an app for real-time music generation with stable diffusion. | Music | |
SoundRaw | AI music generator for creators. | Music |
Source | Description | Game Engine | Type |
---|---|---|---|
DiffSinger | Singing Voice Synthesis via Shallow Diffusion Mechanism. | Singing Voice | |
Retrieval-based-Voice-Conversion-WebUI | An easy-to-use SVC framework based on VITS. | Singing Voice | |
so-vits-svc | SoftVC VITS Singing Voice Conversion. | Singing Voice | |
VI-SVS | Use VITS and Opencpop to develop singing voice synthesis; Different from VISinger. | Singing Voice |
Source | Description | Game Engine | Type |
---|---|---|---|
Applio | Ultimate voice cloning tool, meticulously optimized for unrivaled power, modularity, and user-friendly experience. | Speech | |
Audyo | Text in. Audio out. | Speech | |
Bark | Text-Prompted Generative Audio Model. | Speech | |
Bert-VITS2 | VITS2 Backbone with multilingual bert. | Speech | |
CLAPSpeech | Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training. | Speech | |
EmotiVoice | A Multi-Voice and Prompt-Controlled TTS Engine. | Speech | |
Fliki | Turn text into videos with AI voices. | Speech | |
Glow-TTS | A Generative Flow for Text-to-Speech via Monotonic Alignment Search. | Speech | |
GPT-SoVITS | A Powerful Few-shot Voice Conversion and Text-to-Speech WebUI. | Speech | |
LOVO | LOVO is the go-to AI Voice Generator & Text to Speech platform for thousands of creators. | Speech | |
MahaTTS | An Open-Source Large Speech Generation Model. | Speech | |
Matcha-TTS | A fast TTS architecture with conditional flow matching. | Speech | |
MeloTTS | High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean. | Speech | |
MetaVoice-1B | AI for human-level speech intelligence. | Speech | |
Narakeet | Easily Create Voiceovers Using Realistic Text to Speech. | Speech | |
One-Shot-Voice-Cloning | One Shot Voice Cloning base on Unet-TTS. | Speech | |
OpenVoice | Instant voice cloning by MyShell. | Speech | |
OverFlow | Putting flows on top of neural transducers for better TTS. | Speech | |
RealtimeTTS | RealtimeTTS is a state-of-the-art text-to-speech (TTS) library designed for real-time applications. | Speech | |
SpeechGPT | Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities. | Speech | |
speech-to-text-gpt3-unity | This is the repo I use Whisper and ChatGPT API from OpenAI in Unity. | Unity | Speech |
Stable Speech | Stability AI's Text-to-Speech model. | Speech | |
StableTTS | Next-generation TTS model using flow-matching and DiT, inspired by Stable Diffusion 3. | Speech | |
StyleTTS 2 | Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models. | Speech | |
TorToiSe-TTS | A multi-voice TTS system trained with an emphasis on quality. | Speech | |
TTS Generation WebUI | TTS Generation WebUI (Bark, MusicGen, Tortoise, RVC, Vocos, Demucs). | Speech | |
VALL-E | Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers. | Speech | |
VALL-E X | Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling | Speech | |
Vocode | Vocode is an open-source library for building voice-based LLM applications. | Speech | |
Voicebox | Text-Guided Multilingual Universal Speech Generation at Scale. | Speech | |
VoiceCraft | Zero-Shot Speech Editing and Text-to-Speech in the Wild. | Speech | |
Whisper | Whisper is a general-purpose speech recognition model. | Speech | |
WhisperSpeech | An Open Source text-to-speech system built by inverting Whisper. | Speech | |
X-E-Speech | Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion. | Speech | |
XTTS | XTTS is a library for advanced Text-to-Speech generation. | Speech | |
YourTTS | Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyone. | Speech | |
ZMM-TTS | Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations. | Speech |
Source | Description | Game Engine | Type |
---|---|---|---|
Ludo.ai | Assistant for game research and design. | Analytics |
Source | Description | Game Engine | Type |
---|---|---|---|
CoTracker | It is Better to Track Together. | Video Tool | |
FaceHi | It is Better to Track Together. | Video Tool | |
LGVI | Towards Language-Driven Video Inpainting via Multimodal Large Language Models. | Video Tool | |
MaskViT | Masked Visual Pre-Training for Video Prediction. | Video Tool |