Topic: llmops Goto Github

👇 Here are 310 public repositories matching this topic...

agenta-ai / agenta
llmops,The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
Organization: agenta-ai
Home Page: http://www.agenta.ai
langchain llmops large-language-models llm llm-tools llms prompt-engineering prompt-management llama-index llm-evaluation

ajndkr / lanarky
llmops,The web framework for building LLM microservices
User: ajndkr
Home Page: https://lanarky.ajndkr.com/
fastapi llmops microservices python3 web

arize-ai / phoenix
llmops,AI Observability & Evaluation
Organization: arize-ai
Home Page: https://docs.arize.com/phoenix
ml-observability model-observability ai-roi llmops mlops ai-monitoring ai-observability ml-monitoring model-monitoring umap

bentoml / bentoml
llmops,The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
Organization: bentoml
Home Page: https://bentoml.com
model-serving mlops llmops generative-ai llm-inference model-inference-service inference-platform deep-learning llm-serving machine-learning

bentoml / openllm
llmops,Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
Organization: bentoml
Home Page: https://bentoml.com
llm llmops model-inference falcon fine-tuning stablelm llm-serving llama mpt vicuna

berriai / litellm
llmops,Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
Organization: berriai
Home Page: https://docs.litellm.ai/docs/
anthropic langchain langchain-python llm llmops openai

bionic-gpt / bionic-gpt
llmops,BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
Organization: bionic-gpt
Home Page: https://bionic-gpt.com
architecture full-stack llmops llms rust

composiohq / composio
llmops,Composio equips agents with well-crafted tools empowering them to tackle complex tasks
Organization: composiohq
Home Page: https://docs.composio.dev
agents ai ai-agents aiagents developer-tools function-calling gpt-4 gpt-4o javascript js llm llmops python typescript

dagworks-inc / hamilton
llmops,Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
Organization: dagworks-inc
Home Page: https://hamilton.dagworks.io/en/latest/
data-science python dag data-engineering dataframe etl etl-framework etl-pipeline feature-engineering featurization

decodingml / llm-twin-course
llmops,🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴
Organization: decodingml
aws bytewax comet-ml generative-ai large-language-models machine-learning-engineering ml-system-design mlops qdrant qwak

dillionverma / llm.report
llmops,📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.
User: dillionverma
Home Page: https://llm.report
gpt-3 gpt-4 llm llmops openai nextjs open-source nodejs react shadcn-ui typescript aiops mlops

dot-agent / nextpy
llmops,🤖Self-Modifying Framework from the Future 🔮 World's First AMS
Organization: dot-agent
Home Page: https://dotagent.ai
agent agi ai autogpt gpt llmops mlops ai-agents fastapi fullstack-development

dstackai / dstack
llmops,dstack is an easy-to-use and flexible container orchestrator for running AI workloads in any cloud or data center.
Organization: dstackai
Home Page: https://dstack.ai
machine-learning python aws azure gcp gpu llms cloud orchestration fine-tuning

explodinggradients / ragas
llmops,Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
Organization: explodinggradients
Home Page: https://docs.ragas.io
llm llmops

getmetal / motorhead
llmops,🧠 Motorhead is a memory and information retrieval server for LLMs.
Organization: getmetal
Home Page: https://getmetal.io
machine-learning ml mlops rust llmops llms

giskard-ai / giskard
llmops,🐢 Open-Source Evaluation & Testing for LLMs and ML models
Organization: giskard-ai
Home Page: https://docs.giskard.ai
mlops ml-validation ml-testing ai-testing ai-safety ml-safety llmops ethical-artificial-intelligence responsible-ai fairness-ai

ianarawjo / chainforge
llmops,An open-source visual programming environment for battle-testing prompts to LLMs.
User: ianarawjo
Home Page: https://chainforge.ai/docs
ai evaluation large-language-models llmops llms prompt-engineering

iusztinpaul / hands-on-llms
llmops,🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
User: iusztinpaul
3-pipeline-design aws beam bytewax cicd comet-ml docker fine-tuning generative-ai huggingface langchain llmops llms mlops qdrant qlora streaming transformers

jina-ai / jina
llmops,☁️ Build multimodal AI applications with cloud-native stack
Organization: jina-ai
Home Page: https://docs.jina.ai
neural-search cloud-native deep-learning machine-learning framework grpc kubernetes multimodal mlops pipeline

josh-xt / agixt
llmops,AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
User: josh-xt
Home Page: https://AGiXT.com
ai automation artificial chromadb intelligence llama llamacpp openai python agi llm llmops agent-llm agixt

langfuse / langfuse
llmops,🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
Organization: langfuse
Home Page: https://langfuse.com/docs
analytics llm llmops gpt large-language-models openai self-hosted ycombinator monitoring observability

langgenius / dify
llmops,Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
Organization: langgenius
Home Page: https://dify.ai
ai backend-as-a-service gpt llm openai python rag orchestration gpt-4 agent

liguodongiot / llm-action
llmops,本项目旨在分享大模型相关技术原理以及实战经验。
User: liguodongiot
Home Page: https://www.zhihu.com/column/c_1456193767213043713
llm llm-inference llm-serving llm-training llmops

maplemx / agently
llmops,[AI Agent Application Development Framework] - 🚀 Build AI agent native application in very few code 💬 Easy to interact with AI agent in code using structure data and chained-calls syntax 🧩 Enhance AI Agent using plugins instead of rebuild a whole new agent
User: maplemx
Home Page: http://agently.tech
agent agent-framework python framework agent-based-framework chatglm ernie google-gemini gpt llm-agent llm-application llm-apps llm-framework llmops llms wenxinyiyan gemini claude minimax

microsoft / aici
llmops,AICI: Prompts as (Wasm) Programs
Organization: microsoft
ai rust wasm wasmtime inference language-model llm llm-framework llm-inference llm-serving llmops model-serving transformer

microsoft / autogen
llmops,A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
Organization: microsoft
Home Page: https://microsoft.github.io/autogen/
agent-based-framework agent-oriented-programming chat chat-application chatbot chatgpt gpt gpt-35-turbo gpt-4 llm-agent

msoedov / langcorn
llmops,⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops
User: msoedov
Home Page: https://langcorn.vercel.app/docs
fastapi langchain langchain-python large-language-models api llm vercel vercel-serverless-functions openai-api rest-api

openpipe / openpipe
llmops,Turn expensive prompts into cheap fine-tuned models
Organization: openpipe
Home Page: https://openpipe.ai
ai llm llmops prompt-engineering

pathwaycom / llm-app
llmops,Dynamic RAG for enterprise. Ready to run with Docker,⚡in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
Organization: pathwaycom
Home Page: https://pathway.com/developers/templates/
chatbot hugging-face llm llm-local llm-prompting llm-security llmops pathway real-time vector-index

pezzolabs / pezzo
llmops,🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
Organization: pezzolabs
Home Page: https://pezzo.ai
ai gpt-3 openai devtools gpt-4 prompt-engineering nodejs platform langchain monitoring

phidatahq / phidata
llmops,Build AI Assistants with memory, knowledge and tools.
Organization: phidatahq
Home Page: https://docs.phidata.com
developer-tools python aws ai llm llmops gpt-4

portkey-ai / gateway
llmops,A Blazing Fast AI Gateway. Route to 200+ LLMs with 1 fast & friendly API.
Organization: portkey-ai
Home Page: https://portkey.ai/features/ai-gateway
gateway generative-ai llmops llms prompt-engineering ai-gateway langchain llama-index openai router

predibase / lorax
llmops,Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Organization: predibase
Home Page: https://loraexchange.ai
fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch

promptfoo / promptfoo
llmops,Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
Organization: promptfoo
Home Page: https://www.promptfoo.dev/
llm prompt-engineering prompts llmops prompt-testing testing rag evaluation evaluation-framework llm-eval

protectai / llm-guard
llmops,The Security Toolkit for LLM Interactions
Organization: protectai
Home Page: https://llm-guard.com/
large-language-models llm chatgpt security-tools adversarial-machine-learning prompt-engineering prompt-injection llmops llm-security transformers

protectai / rebuff
llmops,LLM Prompt Injection Detector
Organization: protectai
Home Page: https://playground.rebuff.ai
llm llmops prompt-engineering prompts security prompt-injection

ray-project / ray-llm
llmops,RayLLM - LLMs on Ray
Organization: ray-project
Home Page: https://aviary.anyscale.com
distributed-systems large-language-models ray serving transformers llm llm-inference llm-serving llmops

superduper-io / superduper
llmops,🔮 SuperDuper: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
Organization: superduper-io
Home Page: https://superduper.io
ai mlops torch transformers mongodb python pytorch ml database data

tencentmusic / cube-studio
llmops,cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式
Organization: tencentmusic
kubernetes inference mlops workflow ai pytorch spark argo kubeflow automl

tensorchord / awesome-llmops
llmops,An awesome & curated list of best LLMOps tools for developers
Organization: tensorchord
awesome-list mlops ai-development-tools llmops

tensorchord / envd
llmops,🏕️ Reproducible development environment
Organization: tensorchord
Home Page: https://envd.tensorchord.ai/
developer-tools development-environment docker buildkit hacktoberfest llmops mlops mlops-workflow model-serving

thousandbirdsinc / chidori
llmops,A reactive runtime for building durable AI agents
Organization: thousandbirdsinc
Home Page: https://docs.thousandbirds.ai
agents ai debugging framework llmops llms orchestration

traceloop / openllmetry
llmops,Open-source observability for your LLM application, based on OpenTelemetry
Organization: traceloop
Home Page: https://www.traceloop.com/openllmetry
llmops observability open-telemetry metrics monitoring opentelemetry datascience ml model-monitoring opentelemetry-python

transformeroptimus / superagi
llmops,<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
Organization: transformeroptimus
Home Page: https://superagi.com/
agi ai autonomous-agents python agents artificial-intelligence gpt-4 openai artificial-general-intelligence superagi

truefoundry / cognita
llmops,RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
Organization: truefoundry
Home Page: https://cognita.truefoundry.com
ai deep-learning generative-ai llmops machine-learning mlops model-deployment python rag retrieval-augmented-generation

truera / trulens
llmops,Evaluation and Tracking for LLM Experiments
Organization: truera
Home Page: https://www.trulens.org/
machine-learning neural-networks explainable-ml llm llmops

trypromptly / llmstack
llmops,No-code multi-agent framework to build LLM Agents, workflows and applications with your data
Organization: trypromptly
Home Page: https://llmstack.trypromptly.com
ai generative-ai llm-chain llm-framework llmops llms no-code-ai platform agents ai-agents-framework

uptrain-ai / uptrain
llmops,UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
Organization: uptrain-ai
Home Page: https://uptrain.ai/
machine-learning experimentation llm-prompting llm-test llmops monitoring prompt-engineering autoevaluation evaluation llm-eval

vllm-project / vllm
llmops,A high-throughput and memory-efficient inference and serving engine for LLMs
Organization: vllm-project
Home Page: https://docs.vllm.ai
gpt llm pytorch llmops mlops model-serving transformer llm-serving inference llama

zenml-io / zenml
llmops,ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
Organization: zenml-io
Home Page: https://zenml.io
mlops machine-learning data-science production-ready devops-tools zenml pipelines metadata-tracking deep-learning pytorch