meirwah/awesome-workflow-engines

A curated list of awesome open source workflow engines

awesome-workflow-engines's Issues

Dagster

https://github.com/dagster-io/dagster

Node-red?

Maybe it's because most of my personal projects focus around Home Automation but I'm kind of surprised not to see Node-Red listed here. If there's no objection I'll submit a PR to add it.

Add `contributing.md` file

You could use https://github.com/sindresorhus/awesome/blob/master/contributing.md as inspiration.

ProcessMaker

why ProcessMaker was not listed?

Spring Integration

It seems like Spring Integration (https://spring.io/projects/spring-integration) should be added to this list. It has state machine, message buses, etc. that would appear to put it in this category.

Synapse WFMS

Could you please add Synapse WFMS to the list?

Many thanks!

Another `awesome-`

Just as an FYI there is another curated list of this type of software: https://github.com/pditommaso/awesome-pipeline

Theirs links back to this repository.

Add Piper

would you please add:
https://github.com/creactiviti/piper

Zapier

why Zapier was not listed?

Suggestion: Easy Flow

https://github.com/j-easy/easy-flows

~600 stars 🚀

Pinball has been archived

Add Workflow Core

Workflow Core is a light weight workflow engine targeting .NET Standard. Think: long running processes with multiple tasks that need to track state. It supports pluggable persistence and concurrency providers to allow for multi-node clusters.

https://github.com/danielgerlag/workflow-core

Add Pegasus

https://pegasus.isi.edu/

Suggestion: DBOS Transact

👋 We are building this open source workflow engine called DBOS transact: https://github.com/dbos-inc/dbos-transact

I think it'd pertain to the "embedded usage" category. It is a library of wrappers to organize business logic in workflows.
It provide hooks to automatically recover pending workflows when the program restarts.
The key aspect of the framework is that it manages state for you. Makes it trivial to write SAGAs.

Missing Lyft's Flyte

Announced a few days ago: https://eng.lyft.com/introducing-flyte-cloud-native-machine-learning-and-data-processing-platform-fb2bb3046a59

NirmataOSS workflow

please add NimataOSS:
https://github.com/NirmataOSS/workflow

Activate "Github Pages" for this project

since some time github provides a new feature where you can transform the readme file into a web page

https://meirwah.github.io/awesome-workflow-engines/

This can be activated in : Settings -> Github Pages -> Source = Master Branch

I think this is a nice feature to have a separate web page for your project?
See also here

Suggestion: Dapr Workflows

https://docs.dapr.io/developing-applications/building-blocks/workflow/workflow-overview/

Suggestions: balsam, jobflow, luigi, signac

https://github.com/argonne-lcf/balsam
https://github.com/materialsproject/jobflow
https://github.com/spotify/luigi
https://github.com/glotzerlab/signac

Missing Dagster and Ascend

Add https://github.com/gaia-pipeline/gaia

Missing Taverna e Bonita

https://taverna.incubator.apache.org/
https://www.bonitasoft.com/

PS: no time for PR

Missing Prefect Core

Missing Prefect Core workflow engine (https://www.prefect.io/). It is now also open source ( https://github.com/prefecthq/prefect )

Delete .Rhistory

My PR accidentally included an (empy) .Rhistory file, now in the master branch. You probably want to delete it. My apologies and thanks for putting together this awesome list.

Categorize workflow engines

As more and more systems with difference approaches are listed I think we should provide a categories to avoid comparing apples with pears.
My suggestion is to first insert a short definition of workflow and then create possible categories that can be selected for each product.

A curated list of awesome open source workflow engines

A workflow consists of an orchestrated and repeatable pattern of activity, enabled by the systematic organization of resources into processes that transform materials, provide services, or process information.
A workflow is usually depicted as a sequence of tasks, the work of a person or group within an organization, or a more or less complex mechanism within a complex IT system.

In this sense, the following workflow engines are categorized into differnt groups of

Technical Worklfow Engine (TECH)
Human Centric Workflow Engine (HUMAN)
Batch based Workflow Engine (BATCH)
BPMN based Worklfow Engine (BPMN)

Example:

• Imixs-Workflow - Category: TECH|HUMAN|BPMN Description: powerful human-centric Workflow Engine based on the BPMN 2.0 standard.

What did you all think about such a concept?

please add Zeebe by Camunda

zeebe is another product by camunda.. heavily inspired by apache kafka:
zeebe.io