mycelial Goto Github PK

Mycelial is an open-source software solution that moves data from sources to destinations.

For example, consider an Edge Machine Learning application that stores its information in a local SQLite database.

So, how do you get the information off of your edge device and onto a system where the information can be analyzed?

Well, with Mycelial you can declaratively create data pipelines that move your data from a source system like SQLite, to a destination system like Snowflake.

There are two main components in Mycelial: daemons and a control plane. (Mycelial, Inc. offers a hosted control plane as well! See app.mycelial.com to sign up!)

The daemon is installed and executed on source and destination computers. These daemons will register with the control plane, and they will receive data pipeline specifications from the server.

The control plane offers you a way to set up data pipeline specifications, which move your data from one location to another via the installed daemons. You can set up these data pipelines via a drag-and-drop web interface, or you can add these pipelines via api calls.

Once you've installed Mycelial (daemon[s] and control plane), you can easily begin moving your data from source systems to destination systems of your choosing. Currently Mycelial has connectors for:

• Postgres
• SQLite
• MySQL
• Kafka
• Snowflake
• Amazon Redshift, and
• File streaming

Follow our Tutorial to start using Mycelial from the command line.

Watch this short demo:

API documentation

• Discord
• @mycelial
• Newsletter

Mycelial is available under the Apache 2 license.