Comments (6)
Hi, GentleZhu,
The 10 random runs can be run by setting the exp_round
argument. The 10 random runs in the paper are under the setting of exp_round
from 1 to 10.
Please let me know if any questions.
from good.
I found even I set this parameter and config.exp_round>1, the goodtg or load_task function only run for one round.
from good.
Your code seems to only store different round in a separate folder under storage.
from good.
Hi Gentle Zhu and GOOD team, I have a similar question. It seems we have to manually check each folder from different rounds. Is there any convenient way to aggregate the results?
from good.
Hi!
I found even I set this parameter and config.exp_round>1, the goodtg or load_task function only run for one round.
That's true because we generally run goodtg
in parallel. That is we use a simple script to launch all rounds simultaneously on different GPUs.
For example, you may generate the following commands, and pack them into a list cmd_args
.
goodtg --exp_round 1 --gpu_idx 0--config_file XXX
goodtg --exp_round 2 --gpu_idx 1--config_file XXX
...
goodtg --exp_round 10 --gpu_idx 9 --config_file XXX
After that, you may find the use of package subprocess
helpful.
cmd_args = [XXX, ..., XXX]
subprocess.Popen(shlex.split(cmd_args), close_fds=True, stdout=open('debug_out.log', 'a'), stderr=open('debug_error.log', 'a'), start_new_session=False)
I believe the way to launch your programs on GPUs also depends on your experiment environment (If one is sharing computation resources with others, one cannot launch one's programs aggressively).
Because the results are fully stored, you can aggregate all results after finishing running.
BTW, if you only need to run experiments sequentially, you may find reproduce_round1 useful.
It seems we have to manually check each folder from different rounds. Is there any convenient way to aggregate the results?
Since the log file saving paths (structures) are fully based on your config parameters according to log settings, we don't need to manually check the outcomes. After experiments are completed, another script is needed to read all results. Note that to facilitate reading these results, there is a special line at the end of each log file as the result conclusions.
You can set the --log_file param1_param2_param3
to store results for different hyper-parameters.
(Another way to aggregate results is to read the information stored in model checkpoints. (uncommon))
We will share some convenient scripts after we reorganize these scripts for more general purposes.
Please let me know if any questions.:smile:
from good.
Hi GentleZhu,
We have updated this project to version 1. You can now launch multiple jobs and collect their results easily. Please refer to the new README.
Please let me know if any questions.
from good.
Related Issues (20)
- Dependencies conflicts during package installation HOT 4
- ERROR: Cannot install graph-ood and graph-ood==1.1.1 because these package versions have conflicting dependencies. HOT 3
- run CIGA algorithm error HOT 5
- run final_configs yaml got error HOT 10
- Question of the DIR performance discrepancy between the paper table 13 and leaderboard HOT 10
- Leaderboard results of GOODTwitter HOT 6
- Questions about the GOOD-motif dataset HOT 1
- run CIGA on GOODPCBA dataset got error HOT 2
- Questions about the GOOD-motif dataset HOT 1
- 报错OSError: /home/.local/lib/python3.8/site-packages/torch_sparse/_convert_cuda.so: undefined symbol: _ZN6caffe28TypeMeta21_typeMetaDataInstanceIdEEPKNS_6detail12TypeMetaDataEv HOT 6
- LBAPcore-Configs HOT 2
- Questions about the comparison graph HOT 2
- 请问有计划加入GALA,GIL等最新的graph ood方法吗 HOT 4
- Question about applying split method on new datasets HOT 2
- Question about dataset
- How to fix random seeds? HOT 2
- Hi, about environmental partitioning of the dataset HOT 5
- About more metrics HOT 2
- Hello, I encounter some problems when I use your code. .ERROR: 05/06/2024 07:51:52 PM - utils.py - line 87 : 。It seems that there is a problem with the connection. Is it because it's trying to download the dataset by accessing a certain website? I look forward to your reply. Thank you.Traceback (most recent call last): File "/home/lenovo/anaconda3/envs/JX/lib/python3.9/site-packages/urllib3/connection.py", line 198, in _new_conn sock = connection.create_connection( File "/home/lenovo/anaconda3/envs/JX/lib/python3.9/site-packages/urllib3/util/connection.py", line 85, in create_connection raise err File "/home/lenovo/anaconda3/envs/JX/lib/python3.9/site-packages/urllib3/util/connection.py", line 73, in create_connection sock.connect(sa) OSError: [Errno 101] Network is unreachable。 HOT 1
- hello HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from good.