jasonruonanwang/daliuge

The DALiuGE Execution Engine

Data Activated 流 Graph Engine

DALiuGE is a workflow graph execution framework, specifically designed to support very large scale processing graphs for the reduction of interferometric radio astronomy data sets. DALiuGE has already been used for processing large astronomical datasets in existing radio astronomy projects. It originated from a prototyping activity as part of the SDP Consortium called Data Flow Management System (DFMS). DFMS aimed to prototype the execution framework of the proposed SDP architecture.

Development and maintenance of DALiuGE is currently hosted at ICRAR and is performed by the DIA team.

See the docs/ directory for more information, or visit our online documentation

Installation

To get the latest stable version:

pip install --process-dependency-links daliuge

Otherwise clone this repository, go inside, and run either pip install --process-dependency-links . (preferred) or python setup.py install.

[1]	流 (pronounced Liu) is the Chinese character for "flow".