Jobs are submitted succesfully, but only runs on head node

[henrikbengtsson]

Jobs are submitted succesfully, but only runs on head node

[HenrikBengtsson]

So for the late reply. This sounds like an issue with your job scheduler or your batchtools configuration. Also, I know too little about Rocks to know whether batchtools supports it or not. Here is how I would troubleshoot this:

1. Start by confirming you can run batchtools::batchMap() with your customized Rocks batchtools template file.
2. Only when (1) works, test with future.batchtools. Just launch a simple future, e.g. library(future.batchtools); plan(batchtools_custom, ...); f <- future(Sys.info()); v <- value(f). That "should work" if (1) works
3. Retry with higher-level parallelization frameworks, e.g. foreach and doFuture. If (2) works, then those "should work" too.

[HenrikBengtsson]

FYI, I've transferred this issue from doFuture to future.batchtools since it's very unlikely it's related to doFuture. It's more a future backend issue.

Also, I'll go ahead and close this issue since I think it's batchtools related, but feel free to reopen it if you think there's an issue with future.batchtools per se.