cannot run preprocess data(OSError: [Errno 24] Too many open files)

[uber-research]

cannot run preprocess data(OSError: [Errno 24] Too many open files)

[SwagJ]

Add
import torch.multiprocessing torch.multiprocessing.set_sharing_strategy('file_system')
after import statements. This fix the problem for me.

[EloiZ]

Hi! could you solve this issue? I encounter the same
Thanks

[wuhaoran111]

i also have this problem, does anyone has solved it?

Really confused.

[wuhaoran111]

@SwagJ Thank you. I have fixed it with sudo ulimit -n 65535 to Increase the maximum number of opening files.

[CrisCloseTheDoor]

Thank u all, I 've tried @SwagJ and @wuhaoran111 's solution both and fix the same problem