Collect MaxRSS/Elapsed from sacct when using SLURM?

[henrikbengtsson]

Collect MaxRSS/Elapsed from sacct when using SLURM?

[HenrikBengtsson]

That's a great idea. Yes, it seems to be a common problem - using way more or way less resources than requested is inefficient for both the user and the cluster utilization. I agree that one solution is to provide users with feedback (memory and processing time).

For futures in general, I hope to be able gather some of these stats using R itself (and therefore for all types of futures). I'm planning to add some basic support for this throughout the board, cf. HenrikBengtsson/future#59.

However, for more system-specific information, like the Slurm stats your mentioning, that obviously has to be implemented by the more specific future classes. And for such, I think they should probably be part of batchtools itself and then future.batchtools could provide a way to access/present it.

/cc @mllg