How to use more than 1 worker in Jupyter?

[christophechu]

How to use more than 1 worker in Jupyter?

[wudustan]

I want to +1

I followed along with the Jupyter example for PBMC data. I used the command:

cnmf_obj.factorize(worker_i=0, total_workers=16)

And the output I got was along these lines:

[Worker 0]. Starting task 0.
[Worker 0]. Starting task 16.
[Worker 0]. Starting task 32.
[Worker 0]. Starting task 48.
[Worker 0]. Starting task 64.
[Worker 0]. Starting task 80.
[Worker 0]. Starting task 96.
...

Is it fair to assume that this means the function is being ran over 16 cores? I'm not necessarily seeing a bit spike in core utilisation on my machine.

@dylkot would you be able to comment if you have a second? Or could you point me to any document that discusses the avaialble arguments and their use for the python library.

[livewei]

I want to +1