belencito27/custom-models

Various DataRobot MLOps examples

Custom Models and External Deployments Monitoring

Important Note

This repo contains a library of commonly used tasks submitted by the DataRobot community. They tend to have more complex logic and are meant to be used as-is rather than as a reference. If you are not familiar with DataRobot's Custom Inference Models, Custom Tasks, or Composable ML please see this repo instead for tutorials / reference examples: https://github.com/datarobot/datarobot-user-models

There is also extensive documentation on the platform docs at: https://docs.datarobot.com/

Usage

For each respective guide, follow the instructions in its own .ipynb or .py file. There will also be a requirements.txt file in each folder with instructions on how to create an environment to run everything successfully.

Here is some explanation of the different definitions used throughout:

• MLOps Tracking Agents: MLOps Tracking Agents are used when you want to deploy external models and monitor them in DataRobot. For example, you have a custom (or DataRobot) model and you deploy it in your own Kubernetes cluster (or anywhere really). In those cases, MLOps tracking agents will sent statistics back to DataRobot so that you can still monitor your model's accuracy, service health, data drift, etc.
• MLOps DRUM overview: MLOps DRUM is an open-source framework created and managed by DataRobot that allows you to easily deploy custom models. It provides out of the box consistency & validity checks, as well as single command deployment. DRUM is also seamlessly integreated with the DataRobot platform. If you use the framework, then you can use your custom models directly within the DataRobot platform. Here is the official Github repository for DRUM.
• Custom Inference Models: End to end examples of custom modeling code and how it is structured in order to be deployable using the DataRobot platform. The custom code here is basically taking advantage of the DRUM framework mentioned above.
• Custom Tasks: With Composable AI, DataRobot allows you to manipulate DataRobot created blueprints and add your own custom preprocessing steps. Within custom tasks, there are examples of how your code needs to look like to achieve this.

Some of the notebooks can also be executed through Google Colab.

Important Links

• To learn to use DataRobot, visit DataRobot University
• For General articles on DataRobot and news, visit DataRobot Community
• End to end DataRobot API examples Tutorials for Data Scientists
• DataRobot API examples Examples for Data Scientists

Contents

MLOps Tracking Agents Overview

• MLOps Tracking Agent Notebook: An example of how you can use DataRobot's MLOps Agents functionality to monitor external deployments. Python

MLOps DRUM Overview

• MLOps DRUM Notebook: An example of you can use the DataRobot Model Runner (DRUM) library to test your custom models before deploying them using DataRobot. Python

Custom Inference Model Examples

• Custom Inference Models: Examples in multiple languages on how to create custom inference models. Some of the scripts have been updated to also include the code needed to run this as a custom training model: Multiple Languages

Custom Tasks

• Custom Tasks: Examples of custom-tasks that you can use directly within the DataRobot platform to manipulate blueprints. Check out how they look like and create your own tasks! Multiple Languages

Setup/Installation

Each project folder contains its own instructions on setup and requirements. Furthermore, instructions are also conveniently added to the scripts themselves so that users do not need to share the readme file.

Development and Contributing

If you'd like to report an issue or bug, suggest improvements, or contribute code to this project, please refer to CONTRIBUTING.md.

Code of Conduct

This project has adopted the Contributor Covenant for its Code of Conduct. See CODE_OF_CONDUCT.md to read it in full.

License

Licensed under the Apache License 2.0. See LICENSE to read it in full.