Giter Site home page Giter Site logo

datatalksclub / mlops-zoomcamp Goto Github PK

View Code? Open in Web Editor NEW
10.7K 179.0 2.1K 6.79 MB

Free MLOps course from DataTalks.Club

Jupyter Notebook 99.10% Dockerfile 0.01% Python 0.80% Shell 0.02% Makefile 0.01% HCL 0.06%
machine-learning mlops model-deployment model-monitoring workflow-orchestration

mlops-zoomcamp's Introduction

MLOps Zoomcamp

Our MLOps Zoomcamp course

Taking the course

2024 Cohort

Self-paced mode

All the materials of the course are freely available, so that you can take the course at your own pace

  • Follow the suggested syllabus (see below) week by week
  • You don't need to fill in the registration form. Just start watching the videos and join Slack
  • Check FAQ if you have problems
  • If you can't find a solution to your problem in FAQ, ask for help in Slack

Overview

Objective

Teach practical aspects of productionizing ML services — from training and experimenting to model deployment and monitoring.

Target audience

Data scientists and ML engineers. Also software engineers and data engineers interested in learning about putting ML in production.

Pre-requisites

  • Python
  • Docker
  • Being comfortable with command line
  • Prior exposure to machine learning (at work or from other courses, e.g. from ML Zoomcamp)
  • Prior programming experience (at least 1+ year)

Asking for help in Slack

The best way to get support is to use DataTalks.Club's Slack. Join the #course-mlops-zoomcamp channel.

To make discussions in Slack more organized:

Syllabus

We encourage Learning in Public

  • What is MLOps
  • MLOps maturity model
  • Running example: NY Taxi trips dataset
  • Why do we need MLOps
  • Course overview
  • Environment preparation
  • Homework

More details

  • Experiment tracking intro
  • Getting started with MLflow
  • Experiment tracking with MLflow
  • Saving and loading models with MLflow
  • Model registry
  • MLflow in practice
  • Homework

More details

  • Workflow orchestration
  • Mage

More details

  • Three ways of model deployment: Online (web and streaming) and offline (batch)
  • Web service: model deployment with Flask
  • Streaming: consuming events with AWS Kinesis and Lambda
  • Batch: scoring data offline
  • Homework

More details

  • Monitoring ML-based services
  • Monitoring web services with Prometheus, Evidently, and Grafana
  • Monitoring batch jobs with Prefect, MongoDB, and Evidently

More details

  • Testing: unit, integration
  • Python: linting and formatting
  • Pre-commit hooks and makefiles
  • CI/CD (GitHub Actions)
  • Infrastructure as code (Terraform)
  • Homework

More details

  • End-to-end project with all the things above

More details

Instructors

  • Cristian Martinez
  • Tommy Dang
  • Alexey Grigorev
  • Emeli Dral
  • Sejal Vaidya

Other courses from DataTalks.Club:

FAQ

I want to start preparing for the course. What can I do?

If you haven't used Flask or Docker

If you have no previous experience with ML

  • Check Module 1 from ML Zoomcamp for an overview
  • Module 3 will also be helpful if you want to learn Scikit-Learn (we'll use it in this course)
  • We'll also use XGBoost. You don't have to know it well, but if you want to learn more about it, refer to module 6 of ML Zoomcamp

I registered but haven't received an invite link. Is it normal?

Yes, we haven't automated it. You'll get a mail from us eventually, don't worry.

If you want to make sure you don't miss anything:

Supporters and partners

Thanks to the course sponsors for making it possible to run this course

Do you want to support our course and our community? Reach out to [email protected]

mlops-zoomcamp's People

Contributors

alex-sokolov2011 avatar alexeygrigorev avatar ayoub-berdeddouch avatar balapriyac avatar bprasad123 avatar bsenst avatar buzzkanga avatar dimzachar avatar dorian95 avatar ellacharmed avatar emeli-dral avatar gsenseless avatar jnsofini avatar kvnkho avatar mac2bua avatar mithrandir7 avatar mleiwe avatar nakulbajaj101 avatar neimv avatar olegtaratuhin avatar particle1331 avatar piyush-an avatar qfl3x avatar sejalv avatar soumik12345 avatar svizor42 avatar tmikolajczyk avatar tommydangerous avatar ugm2 avatar zesky665 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

mlops-zoomcamp's Issues

pandas failed to read parquet when python=3.10 and engine=fastparquet

Hey guys,

Not really an issue but in case folks having the same problem -

When I use python 3.10 and fastparquet as the engine, I always get a "system error". Then I managed to read the data as soon as I switched to python 3.9 with pyarror as the engine.

I'm using a M1 macbook air with macOS Monterey. Sorry I forgot to capture the error, but i'll post that if i can recreate it.

Homework Issue

Hello,

Good Morning!!

In the homework we have been asked to use the "For-Hire Vehicle Trip Records". We have been asked to train a linear regression model with Pickup and drop off location as features. But what is the target? There are only 7 columns here which are dispatching_base_nu, pickup_datetime , dropOff_datetime , PUlocationID, DOlocationID, SR_Flag and Affiliated_base_number. PUlocationID and DOlocationID are the two input features and I do not see a target variable. Do we have to predict the trip duration using linear regression? Please clrify

Thanks.

Regards,
Raghav

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.