[Bug] Set resource limit throws error

[cceyda]

[Bug] Set resource limit throws error

[cceyda]

Indeed ulimit -H -s is set to a value. I'm was running on aws sagemaker (so inside a blind container)
I guess this is something to keep in mind for people using docker containers to maybe set their ulimits to unlimited(or other large number)
I'll test when the nightly package drops

[cceyda]

Just tested, it is working. Thank you ~

[yaoyaoding]

Hi @cceyda, the nightly build version of hidet should have this PR in it. Could you have a try?

$ pip install --pre --extra-index-url https://download.hidet.org/whl hidet

[austinmw]

got same error

[yaoyaoding]

Hi @cceyda , thanks for bringing this up!

Hidet uses recursion to traverse the its IR, thus we need a large stack size to process large computation graph and tensor program. This error seems indicate that your operating system has set the hard limit for stack size to a concret value instead of infinity (ulimit -H -s to check).

I have submitted #195 to deal with this case. Now, hidet will not force to set the limit if the hard limit is less than the recommanded size, but emit a warning.

[yaoyaoding]

Let me know if this PR does not solve the problem @cceyda @austinmw, thanks!