Unable to unmount from EC2

[kislyuk]

Unable to unmount from EC2

[kislyuk]

Hi, the per-batch job EBS provisioning code was retired in the latest version of aegea, and is not recommended because of hazards like the one you encountered. Note that after this failure to unmount, you will end up with an orphaned EBS volume that your organization will continue to pay for until you clean it up. This is quite hazardous if nobody is watching out for this type of error, because EBS volumes are not cheap.

I recommend using the EFS auto-mount functionality in the latest version of aegea instead. That way your jobs can use a shared EFS filesystem as their scratch space, and Batch automatically manages mounting and unmounting it for you.

If you must continue to use the EBS batch job volume code, it was updated to incorporate tracking down and terminating processes that prevent a clean unmount:

https://github.com/kislyuk/aegea/blob/develop/aegea/ebs.py#L180

You could try forking your version of aegea and updating this line to see if it makes a difference.

[kislyuk]

In addition to the line above, if you take a look at the commit that originally introduced it in v2.8.0, there is another change that makes the Batch cleanup handler perform a cd / before trying to unmount. This is important because if the top level user process descended into a subdirectory in the mount, it will hold an advisory lock on that subdirectory and the mount will be seen as busy.

609d004

[MrOlm]

Hello,

Thanks again for all of this advice. I was going to just keep an eye on the EBS volumes to make sure there weren't any orphaned ones, but after this message I decided to just update to aegea 4.0.1 and just make the dependencies work out. So far so good.

Thanks again for your quick and helpful reply- much appreciated.

Best,
MO