negin513/dask-tutorial

NCAR Dask tutorial (Spring 2023)

NCAR Dask Tutorial

Welcome to NCAR Dask Tutorial!

Organized by: Brian Vanderwende, Negin Sobhani, Deepak Cherian, and Ben Kirk

The materials and notebooks in this tutorial is published as a Jupyter book here.

Here you will find the tutorial materials from the CISL/CSG Dask Tutorial. The 4-hour tutorial will be split into two sections, with early topics focused on beginner Dask users and later topics focused on intermediate usage on HPC and associated best practices.

This tutorial is open to non-UCAR staff. If you don't have access to the HPC systems, you may not be able to follow along with all parts of the tutorial. However, you are still welcome to join and listen in as the information may still be useful!

Video Recoding: Will be available after the event

Course Outline

• Dask Overview
• Dask Data Arrays
• Dask DataFrames
• Dask + Xarray
• Dask Schedulers
• Dask on HPC Systems
• Dask Best Practices

Prerequisites

Before beginning any of the tutorials, it is highly recommended that you have a basic understanding of Python programming and Python libraries such as NumPy, pandas, and Xarray.

Contributing

We welcome contributions from the community! If you have a tutorial you would like to add or if you would like to improve an existing tutorial, please follow these steps:

Fork the repository.

Clone the repository to your local machine:

git clone https://github.com/your-username/dask-tutorial-repository.git

Create a new branch for your changes:

git checkout -b my-new-tutorial

Make your changes and commit them:

git add .
git commit -m "Add my new tutorial"

Push your changes to your fork:

git push origin my-new-tutorial

Submit a pull request to the original repository.

❓Support

If you have any questions or need help with the tutorials, please open an issue in the repository.

👍 Acknowledgments

• NCAR CSG Team
• ESDS Initiative

License

The tutorials in this repository are released under the MIT License.