octoml Goto Github PK

llm-examples

A repo containing code examples that feature OctoAI's LLM solution

llm-rag-examples

OctoAI LLM RAG samples

macho-dyld

Custom dyld version inherited from original Apple dyld implementation

mlc-llm

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

mlcommons-inference

Fork of MLCommons inference repository to test TVM integration

mlops

CK MLOps components

mlperf-loadgen-harness

A simple Python harness to run an ONNX model in various concurrency and replication configurations against MLCommon's LoadGen to measure throughput.

models

A collection of pre-trained, state-of-the-art models in the ONNX format

octoai-apps

A collection of OctoAI-based demos for OctoML's Youtube Channel etc.

octoai-cartoonizer

Cartoonizer demo for OctoAI compute service launch

octoai-launch-examples

Examples of how to build Generative AI applications powered by the OctoAI compute service.

octoai-octoshop

OctoAI's OctoShop! Transform photos with the power of words and generative AI!

octoai-template-apps

octocloud-templates

octoml-examples

A collection of test models for the OctoML AI acceleration service

octoml-helm-charts

Repository for OctoML-affiliated Helm Charts

octoml-llm-qa

A code sample that shows how to use 🦜️🔗langchain, 🦙llama_index and a hosted LLM endpoint to do a standard chat or Q&A about a pdf document

octoml-profile

Home for OctoML PyTorch Profiler

onnx-golive

ONNX Runtime(ORT) Go Live, is a python package that automates the process of accelerating models with ONNX Runtime(ORT). It contains two parts including model conversion to ONNX with correctness checking and auto performance tuning with ORT. Users can run these two together through a single pipeline or run them independently as needed.

onnx-pb-rs

Protobuf definitions for onnx models

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

opentelemetry-datadog

DataDog integration with the OpenTelemetry crate, copied and adapted from opentelemetry-contrib https://github.com/open-telemetry/opentelemetry-rust/tree/master/opentelemetry-contrib.

power-dev

Dev repo for power measurement for the MLPerf™ benchmarks

public-tvm-docker

Build TVM docker image for production compilation deployments

qualcomm

relax

A fork of tvm/unity

relax-all

A fork of tvm/unity

relax-site

docs for octoml/relax: https://octoml.github.io/relax-site/

relay-to-js

A translator from a serialized relay graph layout into a structured graph object in JavaScript/TypeScript

rust-goauth

Crate for authenticating Server to Server Apps for Google Cloud Engine.