multiparty/conclave

Query compiler for secure multi-party computation.

Conclave

Infrastructure for defining and running large data workflows against multiple backends.

Purpose

This framework allows users to define data analysis workflows in familiar frontend languages and then execute them on multiple data storage and processing backends (including privacy-preserving backend services that support secure multi-party computation).

Dependencies

Conclave requires a Python 3.5 environment and was tested on Ubuntu (14.04+). See requirements.txt for other dependencies.

Consider using pyenv (https://github.com/pyenv/pyenv) to avoid changing python to python3 in a bunch of places.

Setup

Run pip install -r requirements.txt.

Testing

The library comes with a number of tests::

nosetests --with-doctest

Network Setup

Note that the benchmarks under benchmarks/ assume that party 1 is reachable at ca-spark-node-0, party 2 at cb-spark-node-0, and party 3 at cc-spark-node-0. You can modify your /etc/hosts file to map IP addresses to host addresses. To map the above to 127.0.0.1 (for a local run) include the following entry in your /etc/hosts file:

127.0.0.1	ca-spark-node-0 cb-spark-node-0 cc-spark-node-0

Most likely you already have a mapping for localhost, for example:

127.0.0.1	localhost

In that case, just append the node addresses after localhost.

You can also modify the party addresses inside CodeGenConfig by updating the network_config dict.

Disclaimer

This is experimental software and does not guarantee security or correctness.

conclave's Issues

Add ability to invoke dispatch scripts with sudo prefix in configuration.

It would sometimes be useful while debugging to allow conclave/dispatch scripts that call backends (e.g., Spark) to use the sudo prefix. This should be an option in the configuration files.

issues about std_dev case: Cannot read property 'length' of undefined

As title, I have run successfully in count and sum,but when i run in std_dev and mean, it meet error :

(node:1327352) UnhandledPromiseRejectionWarning: TypeError: Cannot read property 'length' of undefined
at __unwipe (/conclave-master/jiff/lib/client/protocols/arrays/open.js:60:30)
at open_ND_array (/conclave-master/jiff/lib/client/protocols/arrays/open.js:69:7)
at open (/conclave-master/demo/data/example-jiff-job-1/mpc.js:631:34)
at /conclave-master/demo/data/example-jiff-job-1/mpc.js:696:28
at processTicksAndRejections (internal/process/task_queues.js:95:5)
(Use node --trace-warnings ... to show where the warning was created)
(node:1327352) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag --unhandled-rejections=strict (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 2)
(node:1327352) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.

and

(node:1327352) UnhandledPromiseRejectionWarning: TypeError: Cannot read property 'length' of undefined
at stdDev (/conclave-master/demo/data/example-jiff-job-1/mpc.js:604:34)
at runMicrotasks ()
at processTicksAndRejections (internal/process/task_queues.js:95:5)
(node:1327352) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag --unhandled-rejections=strict (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 3)

how can i slove it? Could you please give a sample test example for std_dev
Looking for your help sincerely!

sm_compile_to_remote.sh missing?

The shell script named above is generated during CodeGen. However it does not exist in the repository.

Any introduction on how to use JIFF as the MPC backend?

I saw some JIFF related code, but not sure what's the proper way to use it.

Where can I find sharemind-client

how to run docker sharemind-client ?
thanks

issues about std_dev case: Cannot read property 'length' of undefined

As title, I have run successfully in count and sum,but when i run in std_dev and mean, it meet error :

(node:1327352) UnhandledPromiseRejectionWarning: TypeError: Cannot read property 'length' of undefined
at __unwipe (/conclave-master/jiff/lib/client/protocols/arrays/open.js:60:30)
at open_ND_array (/conclave-master/jiff/lib/client/protocols/arrays/open.js:69:7)
at open (/conclave-master/demo/data/example-jiff-job-1/mpc.js:631:34)
at /conclave-master/demo/data/example-jiff-job-1/mpc.js:696:28
at processTicksAndRejections (internal/process/task_queues.js:95:5)
(Use node --trace-warnings ... to show where the warning was created)
(node:1327352) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag --unhandled-rejections=strict (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 2)
(node:1327352) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.

and

(node:1327352) UnhandledPromiseRejectionWarning: TypeError: Cannot read property 'length' of undefined
at stdDev (/conclave-master/demo/data/example-jiff-job-1/mpc.js:604:34)
at runMicrotasks ()
at processTicksAndRejections (internal/process/task_queues.js:95:5)
(node:1327352) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag --unhandled-rejections=strict (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 3)

how can i slove it? Could you please give a sample test example for std_dev
Looking for your help sincerely!

question about "python version"

Does it have to be version python3.5? python3.8 is it ok?

nosetests -> nosetests3

I believe in Ubuntu 14.04LTS and 16.04LTS, python 2 is still the default environment. In other words, if we type

nosetests

It will give you

$ nosetests
The program 'nosetests' is currently not installed. You can install it by typing:
sudo apt install python-nose

So maybe changing it to

nosetests3 on the README.md?