alexsworld/ides

智能数据探索服务(Intelligent Data Exploration Service)

IDES(智能数据探索服务)

IDES is short name of Intelligent Data Exploration Service, aka DataLinked.

Features

• Load and save various data sources for data exploration (such as ETL)
• Support standard SQL for data processing
• Support native Scala/Spark code execution
• ...

Building DataLinked(Ides) from Source

Prerequisites for building DataLinked:

• Unix-like environment (we use Linux, Mac OS X, Cygwin, WSL)
• Git
• Maven (we recommend version 3.5.4)
• Java 8 or 11 (we recommend version 1.8)

git clone https://github.com/bebee4java/ides.git
cd ides
./bin/ides-build.sh

Now we got the executable distribution package, like this ides-1.0.0-bin-spark2.4.tgz.

NOTE: Maven 3.5.4, java 1.8.0_271 in Mac OS X are tested.

deploy DataLinked

• You can use bin/ides-shell.sh to start a Ides serve after unpack the distribution (tgz) package.
• We recommend to run it use yarn-client or local mode in spark cluster after packaged jar(can use bin/package.sh).

Fork and Contribute

This is an active open-source project. We are always open to people who want to use the system or contribute to it. Contact us if you are looking for implementation tasks that fit your skills.

If you plan to contribute to this repository, we recommend you to create an issue at our Issue page first, then commit your source code or other topic (e.g., documentation, new idea and proposal).