liquid

Transform Transformers Into Liquid Transformers

liquidnet

Experiments with Liquid Neural Nets

lm-infinite

Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"

logicguide

Plug in and Play implementation of "Certified Reasoning with Language Models" that elevates model reasoning by 40%

longnet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

math-arxviv

All mathematics research papers sourced from ArXiv and meticulously curated for LLM pretraining purposes.

med-flamingo

Democratization of Med-Flamingo, "Med-Flamingo: A Multimodal Medical Few-shot Learner"

med-flamingo1

med-palm

Towards Generalist Biomedical AI

meta-tree-of-thoughts

Tree of Thoughts with an meta prompt for 50% boost in model reasoning

mindvideo

Democratization of "Cinematic Mindscapes: High-quality Video Reconstruction from Brain Activity" in Pytorch

minerva

Implementation of Minerva from "Minerva: Solving Quantitative Reasoning Problems with Language Models"

mit

"Multimodal Instruction Tuning", An SOTA video dataset

model-infra-template

A template for deploying ultra powerful LLMs effortlessly with the best optimizations

model-training-template-for-aws

Boilerplate template to train AI models on AWS with CUDA

monte-carlo-tree-of-thoughts

An experimental inquiry into monte carlo tree of thoughts algorithmic systems

moss-rlhf

MOSS-RLHF

moviechat

🔥 chat with over 10K frames of video!

mpbs

MPBS - Model PreTraining Benchmarking Suite to test various metrics for pytorch models before pretraining, training, finetuning, or inference.

multi-modality-tree-of-thoughts

Multi-Modality Trees of Thoughts

multigroupqueryattention

Implementation of the all-new paper "GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints"

multimodal-self-distillation

A generalized self-supervised training paradigm for unimodal and multimodal alignment and fusion.

multiqueryattention

This is a simple torch implementation of the high performance Multi-Query Attention

nanobotforge

NanoForge is a powerful Rust package specifically crafted for designing and manufacturing ultra-high-performance nanomachines. It is positioned to be the PyTorch equivalent in the nanotechnology domain, merging simplicity with high performance.

nanocad

open-source nanotech CAD

nanox

A Transformer GAN with Reinforcement Learning on generating novel ready to mass manufacture nanomachines

nebula

1 Loss Function For Everything

neocortex

An Multi-Modality Foundation Model for Humanoid robots

neva

The open source implementation of "NeVA: NeMo Vision and Language Assistant"

nucleotide-transformer

🧬 Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics