Topic: serving Goto Github
Some thing interesting about serving
Some thing interesting about serving
serving,In this repository, I will share some useful notes and references about deploying deep learning-based models in production.
User: ahkarami
serving,ClearML - Model-Serving Orchestration and Repository Solution
Organization: allegroai
Home Page: https://clear.ml
serving,A stand alone industrial serving system for angel.
Organization: angel-ml
serving,This repository provides AI/ML service(MachineLearning model serving) modernization solution using Amazon SageMaker, AWS CDK, and AWS Serverless services.
Organization: aws-samples
serving,This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.
Organization: aws
serving,A collection of model deployment library and technique.
User: balavenkatesh3322
serving,ML pipeline orchestration and model deployments on Kubernetes.
Organization: bodywork-ml
Home Page: https://bodywork.readthedocs.io/en/latest/
serving,Deployment template for a continuous training pipeline.
Organization: bodywork-ml
Home Page: https://bodywork.readthedocs.io/en/latest/quickstart_ml_pipeline/
serving,MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
Organization: cap-ntu
Home Page: https://mlmodelci.com
serving,This hands-on lab walks you through a step-by-step approach to efficiently serving and fine-tuning large-scale Korean models on AWS infrastructure.
User: daekeun-ml
serving,LoRA fine-tuned Stable Diffusion Deployment
User: deep-diver
Home Page: https://deep-diver.github.io/LoRA-deployment/
serving,A universal scalable machine learning model deployment solution
Organization: deepjavalibrary
serving,DELTA is a deep learning based natural language and speech processing platform.
Organization: delta-ml
Home Page: https://delta-didi.readthedocs.io/
serving,A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and ultra-low latency.
Organization: dingodb
Home Page: https://www.dingodb.com
serving,TensorFlow Serving ARM - A project for cross-compiling TensorFlow Serving targeting popular ARM cores
User: emacski
serving,An object oriented (OOP) approach to train Tensorflow models and serve them using Tensorflow Serving.
User: erdememekligil
serving,Friendli: the fastest serving engine for generative AI
Organization: friendliai
Home Page: https://friendli.ai
serving,Database system for AI-powered apps
Organization: georgia-tech-db
Home Page: https://evadb.ai/docs
serving,MLOps Platform
Organization: hydrospheredata
Home Page: http://docs.hydrosphere.io
serving,Spark ML Lib serving library
Organization: hydrospheredata
serving,A lightweight server for LightGBM
User: jeongukjae
serving,bring keras-models to production with tensorflow-serving and nodejs + docker :pizza:
User: krystianity
serving,AsyncIO serving for data science models
Organization: laactechnology
Home Page: https://www.foxcross.dev/
serving,High-throughput serving engine for AI models. Friendly interface. Enterprise scale.
Organization: lightning-ai
Home Page: https://lightning.ai/docs/litserve
serving,A unified end-to-end machine intelligence platform
Organization: meta-soul
serving,Python library for Modzy Machine Learning Operations (MLOps) Platform
Organization: modzy
serving,【深度学习模型部署框架】支持tensorflow/torch/tensorrt/vllm以及更多nn框架,支持dynamic batching、streaming模式,支持Python/C++双语言,可限制,可拓展,高性能。帮助用户快速地将模型部署到线上,并通过HTTP/RPC接口方式提供服务。
Organization: netease-media
Home Page: https://zhuanlan.zhihu.com/p/707491462
serving,Serve your fastText models for text classification and word vectors
Organization: nielsen-oss
serving,Deploy DL/ ML inference pipelines with minimal extra code.
Organization: notai-tech
serving,A scalable inference server for models optimized with OpenVINO™
Organization: openvinotoolkit
Home Page: https://docs.openvino.ai/2024/ovms_what_is_openvino_model_server.html
serving,Blockchain Search with GraphQL APIs
Organization: outcaste-io
Home Page: https://manishrjain.com/outserv-graphql-blockchain-search
serving,⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
Organization: paddlepaddle
Home Page: https://www.paddlepaddle.org.cn/fastdeploy
serving,A flexible, high-performance carrier for machine learning models(『飞桨』服务化部署框架)
Organization: paddlepaddle
serving,pytorch during training, libtorch during serving via gRPC
User: peter-chou
serving,Lineage metadata API, artifacts streams, sandbox, API, and spaces for Polyaxon
Organization: polyaxon
serving,Serve, optimize and scale PyTorch models in production
Organization: pytorch
Home Page: https://pytorch.org/serve/
serving,A comprehensive guide to building RAG-based LLM applications for production.
Organization: ray-project
serving,Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Organization: ray-project
Home Page: https://ray.io
serving,RayLLM - LLMs on Ray
Organization: ray-project
Home Page: https://aviary.anyscale.com
serving,An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
Organization: seldonio
Home Page: https://www.seldon.io/tech/products/core/
serving,Reasonable API for serving TensorFlow models using Scala
User: stormy-ua
serving,A flexible, high-performance serving system for machine learning models
Organization: tensorflow
Home Page: https://www.tensorflow.org/serving
serving,Generic and easy-to-use serving service for machine learning models
User: tobegit3hub
Home Page: https://stfs.readthedocs.io
serving,TensorFlow template application for deep learning
User: tobegit3hub
serving,Serving Inside Pytorch
Organization: torchpipe
Home Page: https://torchpipe.github.io/
serving,Knativeのコンポーネントを理解しながらFaaSプラットフォームをDIYするワークショップです
User: toshi0607
serving,Python + Inference - Model Deployment library in Python. Simplest model inference server ever.
Organization: underneathall
Home Page: https://pinferencia.underneathall.app
serving,A high-performance inference system for large language models, designed for production environments.
Organization: vectorch-ai
Home Page: https://docs.vectorch.com/
serving,AI + Data, online. https://vespa.ai
Organization: vespa-engine
Home Page: https://vespa.ai
serving,부스트캠프 AI Tech - Product Serving 자료
User: zzsza
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.