Comments (6)
Hello,
Thank you for bringing this to our attention. Maybe you can try adding the flag --preconfig default
and see if that helps. So your command would look like
sudo cpac run /home/tjlagrow/Documents/ADNI/sNC_f/bids_dir /home/tjlagrow/Documents/ADNI/sNC_f/outputs test_config --platform docker --preconfig default
Please let me know if that helps or if any other error arises.
from c-pac.
Thank you for your detailed comments! I was able to run your command on my system without any hanging issues or redundancy issues (Ubuntu 18.04.1 LTS).
Are you still using the latest version of CPAC (v1.8.5)? To upgrade the version, you can do cpac --platform docker --tag latest pull
and you can also add --tag latest
in your cpac run command to ensure you are using the latest version.
Also, can you show maybe a tree of how your bids directory looks like? I can try mimicking it to see if I run into the same issue.
from c-pac.
Thank you for the prompt response, I appreciated it!
I was able to use the latest docker image when using the --preconfig default
flag. However, I am still running into the same issue of virtually no processing. This was not an issue previously and I am unsure what to do to help correct this. I did several tests both on my system and docker for both ram health and harddrive health - both are healthy. I also attempted a fresh install of Ubuntu 20.04 LTS to no added benefit. Is there maybe something else I'm missing?
Previously, I was able to use the test_config command and the process would finish in under a minute. With the new update, the process is hanging up for minutes on each nipype.workflow process. I have tried a great number of times and I have still yet to complete one subject using test_config. I will post one of my run's output. I am trying to use the test_config command on 3 HCP participants, each with 4 scans. I expect 12 outputs but after 15 minutes, I have yet to get through 1 scan of "connecting...".
cpac_docker_processing_issue.txt I will continue to let this current process go to see what happens and will report here if/when the process finishes.
Additionally, when I process a bids directory, the overarching data_config and file pipeline_config are generated for each subject AND scan, generating quite a lot of redundancy.
Please let me know if you need any further information.
from c-pac.
I was able to get through 1 scan with the output log (pypeline.log). What took usually under a minute is now taking over 3 hours. I am a little lost on what is going on here or if I need to update a specific package in the docker image (nipype?) or if something else locally is going on? I stopped the process since this is just a test_config
run. I took another scan I've run before and I'm trying to run the participant
command. I will report back if there is an issue with the processing when the initial nipype.workflow connecting *...
finishes.
I am now running:
sudo cpac -vv run /home/tjlagrow/Documents/hcp_data/bids_dir_small /home/tjlagrow/Documents/hcp_data/outputs participant --platform docker --preconfig default \ --data_config_file /home/tjlagrow/Documents/hcp_data/outputs/cpac_data_config_99fd7508_2023-06-08T15-31-42Z.yml \ --pipeline_config_file /home/tjlagrow/Documents/hcp_data/outputs/cpac_pipeline_config_99fd7508_2023-06-08T15-31-42Z.yml \ --mem_gb 60.0 --n_cpus 16
from c-pac.
Thank you for your quick comments!
I am unsure what changed but I was able to run the processes on two systems on different linux distros (Ubuntu 20.04 LTS and CentOS) without a processing issues. This was true for both CPAC v1.8.4 and v1.8.5. I am not sure why it fixed the issue, but using sudo python3 -m cpac ...
ended up doing the trick. I am not sure if it was a pathing issue for specific packages but that shouldn't be the case with the dockerized code.
In terms of a file structure, attached is a printout. This is the result of ls -R
which is a little messy.
file_structure.txt
from c-pac.
@tjlagrow I'm glad you were able to get cpac
to run. The issue here I believe is just a little asynchrony in the release cycles of the various C-PAC packages β C-PAC itself v1.8.5 is available, but the latest version's documentation isn't locked yet, and the changes necessary for the cpac
convenience wrapper to work seamlessly with v1.8.5 are not yet merged / released / published.
In case anyone finds this issue when C-PAC is ahead of cpac and the docs, the nightly documentation for running directly in Docker or in Singularity is another way to run the latest (or nightly) image when cpac
isn't yet supporting that version. Or if you aren't necessarily wanting to use the bleeding edge version, you can specify a less-recent version --tag
like
cpac --tag release-v1.8.4 run /home/tjlagrow/Documents/ADNI/sNC_f/bids_dir /home/tjlagrow/Documents/ADNI/sNC_f/outputs test_config
to run the second-most-recent version of C-PAC (the most recent version currently supported by cpac
)
Or, if you do want bleeding-edge and like to live dangerously, you can pip install cpac
from an unreleased branch or commit like
pip install git+https://github.com/FCP-INDI/cpac.git@cpac_resources
or
pip install git+https://github.com/FCP-INDI/cpac.git@cabac8b820075876cfc28966071306b9314c139e
to install a development version of the wrapper.
Duplicate of FCP-INDI/cpac#35
from c-pac.
Related Issues (20)
- π½οΈ Google Analytics 4 is replacing Universal Analytics. On July 1, 2023 all standard Universal Analytics properties will stop processing data.
- β¨ Adapt safer shell calls HOT 1
- π· Use "Docker Metadata Action" to handle semver & branch tags
- π½οΈ Ubuntu 18.04 LTS 'Bionic Beaver' reached EOL on May 31, 2023 HOT 1
- π¨ Replace NodeBlock function parameters with a dataclass
- π¦οΈ Build AFNI without SUMA HOT 1
- π¦οΈ Reduce FSL 6 size HOT 3
- 𧱠Make all multi-stage staging images branch specific
- β¨ Utility which can parse all NodeBlocks and produce a catalog
- β¨ Easier way for users to get a blank config and modify quickly
- π `create_nuisance_regression_workflow`: `TypeError: 'NoneType' object is not subscriptable`
- π ndmg pipeline stalls indefinitely in anat_skullstrip
- β¨ Better error reporting when CSF mask is empty
- π Using the unfiltered head motion parameters (rotation and translation) for nuisance regression even for forks with the filter on? HOT 2
- β¨ Re-align CPAC:fmriprep-options preconfig to fmriprep LTS
- π `[smoothed, unsmoothed]` not forking HOT 2
- π np.bool deprecated
- β¨ Add Regressor Interpolation at Progressive Time Delays (RIPTiDe) to C-PAC
- π `in copyfileοΌos.unlink(newfile)οΌFileNotFoundError: [Errno 2] No such file or directory`
- π Sparsity thresholds not scaling for network centrality HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from c-pac.