Comments (9)
The same was happening to me. I still can't get PBS to work with my cluster, but I was able to solve this problem. In qsub.jl
file on line 98, it looks for the file generated by PBS for the node information. However, atleast for the cluster I am using, the expression it was trying to match (variable fname
) was different than the actual filename.
On line 92 of qsub.jl
, is where the function is defined. I had to change mine to
filename(i) = isPBS ? "$home/julia-$(getpid()).o$id-$i" : "$home/julia-$(getpid()).o$id.$i"
from clustermanagers.jl.
Any progress on that matter? I tried again on a different PBS cluster. Still the same issue.
from clustermanagers.jl.
@affans could you please confirm this fixed in master?
Should this issue be closed?
from clustermanagers.jl.
using file systems for interprocess communication is generally a bad idea. try addprocs_qrsh
instead.
from clustermanagers.jl.
Hi @bjarthur , I have just tried addprocs_qrsh
as you suggested and got the following error:
Error launching workers
could not spawn `qrsh -q class -V -N julia-41243 -now n cd /home/juliohm '&&' /usr/loca/julia/julia-903644385b/bin/julia --worker UHNgiG1KIXPRm6A4`: no such file or directory (ENOENT)
Do you have an idea of what may be happening?
from clustermanagers.jl.
have you tried cutting and pasting the command in the error message directly into a bash terminal? breaking it down into parts would help isolate the problem:
cd /home/juliohm
/usr/loca/julia/julia-903644385b/bin/julia --worker UHNgiG1KIXPRm6A4
, and then,qrsh -q class -V -N julia-41243 -now n ls
i don't have access to a PBS cluster anymore, so am not able to provide much more help.
from clustermanagers.jl.
Hi @bjarthur sorry for the delay in the reply. I tried copying the commands in the root node, but the first command hangs indefinitely. Do you have any other suggestion on how to debug this?
from clustermanagers.jl.
I think the hope in this case is to use MPI.jl, they have a MPIManager defined there now that should work in theory. I will try it as soon as I find some time.
from clustermanagers.jl.
We are trying to revive the package. Please review the latest stable release (released today) and report any issues. PRs are more than welcome!
from clustermanagers.jl.
Related Issues (20)
- ElasticManager does not export get_connect_cmd
- htcondor manager: failure when listening to a telnet commu HOT 4
- Extra options on SGE HOT 5
- Error in `rmprocs` SGE HOT 1
- Ship telnet via jll? HOT 2
- addprocs(SGEManager) fails HOT 5
- SGE fails in rmprocs
- Singularity images does not work with SLURM HOT 5
- Error launching workers: no such file or directory HOT 5
- TagBot trigger issue HOT 8
- lsf_bpeek makes strong assumptions on iterator state of retry_delays
- [SlurmManager] 100 % CPU usage while waiting for the job to get created HOT 6
- Better handling of SLURM job submission timing
- Handling of busy LSF deamon HOT 4
- SLURM 10 nodes good, 16 nodes error HOT 3
- pbs error HOT 4
- LSF manager broken in Julia 1.8.1 HOT 2
- -o argument in addprocs_slurm leads to an error
- ClusterManagers can be run on top of dask clusters! HOT 2
- Elastic auto IP address function HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clustermanagers.jl.