shuhaosong Goto Github PK

convert2onnx

LLM2Onnx

headscale

An open source, self-hosted implementation of the Tailscale control server

jobrunner

Framework for performing work asynchronously, outside of the request flow

juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

kubernetes

Production-Grade Container Scheduling and Management

kuiperdatawhale

osm

Open Service Mesh (OSM) is a lightweight, extensible, cloud native service mesh that allows users to uniformly manage, secure, and get out-of-the-box observability features for highly dynamic microservice environments.

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

tailscale

The easiest, most secure way to use WireGuard and 2FA.

tensorrt

NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

tensorrt-llm

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

tensorrtllm_backend

The Triton TensorRT-LLM Backend