morpheusph Goto Github PK

application

Application metadata descriptor CRD

awesome-scalability

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

bigscience

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

ca-generator

coredns

CoreDNS is a DNS server that chains plugins

cri-o

Open Container Initiative-based implementation of Kubernetes Container Runtime Interface

embedding-server

A (hopefully) performant implementation of a sentence-transformer embedding server. This repo is forked from https://github.com/huggingface/text-generation-inference

fastapi-keycloak-middleware

A middleware for FastAPI that allows easy authentication and authorisation tailored for Keycloak

gitops-demo

gpts

leaked prompts of GPTs

harbor-helm

The helm chart to deploy Harbor

helm-controller

The GitOps Toolkit Helm reconciler, for declarative Helming

k8s_practices

k8ssandra-operator

The Kubernetes operator for K8ssandra

keycloak-api-key-module

kong-plugin-authz-keycloak-jwt-token

https://github.com/MorpheusPH/kong-plugin-authz-keycloak-jwt-token

kubernetes-study

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

local-path-provisioner

Dynamically provisioning persistent local storage with Kubernetes

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

nfs-subdir-external-provisioner

Dynamic sub-dir volume provisioner on a remote NFS server.

patch-gateway

skopeo

Work with remote images registries - retrieving information, images, signing content

source-controller

The GitOps Toolkit source management component

system-design-interview

System design interview for IT companies

system-design-primer

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

tensorrt-llm

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

tensorrtllm_backend

The Triton TensorRT-LLM Backend

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

transformers-bloom-inference

Fast Inference Solutions for BLOOM