oobabooga Goto Github PK

ai-notebooks

alpaca-lora

Instruct-tuning LLaMA on consumer hardware

alpaca_lora_4bit

audiocraft-infinity-webui

autogptq

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

bitsandbytes

8-bit CUDA functions for PyTorch

bitsandbytes-windows-webui

Windows compile of bitsandbytes for use in text-generation-webui.

blockmerge_gradient

Merge Transformers language models by use of gradient parameters.

character-editor

Create, edit and convert AI character files for CharacterAI, Pygmalion, Text Generation, KoboldAI and TavernAI

chatbot-ui

An open source ChatGPT UI.

chatrwkv

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

easylm

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

flash-attention

Fast and memory-efficient exact attention - Windows wheels

flexgen

Running large language models on a single GPU for throughput-oriented scenarios.

g-diffuser-bot

Discord bot for diffusers (Stable Diffusion)

gptq

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

gptq-for-llama

4 bits quantization of LLaMa using GPTQ

gptq-for-llama-wheels

Precompiled Wheels for GPTQ-for-LLaMa

gradio

Create UIs for your machine learning model in Python in 3 minutes

llama

Inference code for LLaMA models

llama-cpp-python

Python bindings for llama.cpp

llama-cpp-python-cublas-wheels

Wheels for llama-cpp-python compiled with cuBLAS support

llama.cpp

Port of Facebook's LLaMA model in C/C++

llamacpp-python

Python bindings for llama.cpp

llm-tools

Various scripts for working with local LLMs

minigpt-4-pipeline

mtj-softtuner

Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance

one-click-installers

Simplified installers for oobabooga/text-generation-webui.

oobabooga-one-click-bandaid

A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda