Giter Site home page Giter Site logo

GitHub Workflow Status Release Roadmap GitHub last commit

FuseML

Fuse your favourite AI/ML tools together for MLOps orchestration

Build your own custom MLOps orchestration workflows from composable automation recipes adapted to your favorite AI/ML tools, to get you from ML code to inference serving in production as fast as lighting a fuse.

Overview

Use FuseML to build a coherent stack of community shared AI/ML tools to run your ML operations. FuseML is powered by a flexible framework designed for consistent operations and a rich collection of integration formulas reflecting real world use cases that help you reduce technical debt and avoid vendor lock-in.

Inception and Roadmap

FuseML originated as a fork of our sister open source project Epinio, a lightweight open source PaaS built on top of Kubernetes, then has been gradually transformed and infused with the MLOps concepts that make it the AI/ML orchestration tool that it is today.

The project is under heavy development following the main directions:

  1. adding features and enhancements to improve flexibility and extensibility
  2. adding support for more community shared AI/ML tools
  3. creating more composable automation blocks adapted to the existing as well as new AI/ML tools

Take a look at our Project Board to see what we're working on and what's in store for the next release.

Basic Workflow

The basic FuseML workflow can be described as an MLOps type of workflow that starts with your ML code and automatically runs all the steps necessary to build and serve your machine learning model. FuseML's job begins when your machine learning code is ready for execution.

  1. install FuseML in a kubernetes cluster of your choice (see Installation Instructions)
  2. write your code using the AI/ML library of your choice (e.g. TensorFlow, PyTorch, SKLearn, XGBoost)
  3. organize your code using one of the conventions and experiment tracking tools supported by FuseML
  4. use the FuseML CLI to push your code to the FuseML Orchestrator instance and, optionally, supply parameters to customize the end-to-end MLOps workflow
  5. from this point onward, the process is completely automated: FuseML takes care of all aspects that involve building and packaging code, creating container images, running training jobs, storing and converting ML models in the right format and finally serving those models

Supported 3rd Party Tools

Experiment Tracking and Versioning

  • MLFlow
  • DVC (TBD)

Model Training

  • MLFlow
  • DeterminedAI (TBD)

Model Serving and Monitoring

  • KServe
  • Seldon Core (coming soon)
  • Knative Serving (coming soon)

Project Layout

This repository contains the code for the FuseML installer and is the main project repository. Other repositories of interest are:

FuseML's Projects

docs icon docs

This is the main repository for the FuseML documentation. https://fuseml.github.io/docs is published through this repo

examples icon examples

A collection of machine learning projects serving as sample applications that can be deployed with FuseML.

fuseml icon fuseml

FuseML aims to provide an MLOps framework as the medium dynamically integrating together the AI/ML tools of your choice. It's an extensible tool built through collaboration, where Data Engineers and DevOps Engineers can come together and contribute with reusable integration code.

fuseml-core icon fuseml-core

FuseML APIs and core service. This repo include the FuseML client useful to interact with the background services.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.