IResourceManager GenericResources.CheckExistenceAsync call on existing VM fails with "503 Service Unavailable"

[azure]

IResourceManager GenericResources.CheckExistenceAsync call on existing VM fails with "503 Service Unavailable"

[hovsepm]

@abhi1509 what is the version of Microsoft.Azure.Management.ResourceManager.Fluent package in your project?

[abhi1509]

1.3. Tried 1.4 but can’t install. It says system.runtime missing from GAC.

…

On Nov 27, 2017, at 6:11 PM, Hovsep ***@***.***> wrote: @abhi1509 what is the version of Microsoft.Azure.Management.ResourceManager.Fluent package in your project? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

[hovsepm]

@abhi1509 what is your dev box configuration? I'll need to have a repro locally to investigate. Did you check fiddler logs?

[abhi1509]

Windows 10 VS 15 update 3

…

On Nov 27, 2017, at 6:14 PM, Hovsep ***@***.***> wrote: @abhi1509 <https://github.com/abhi1509> what is your dev box configuration? I'll need to have a repro locally to investigate. Did you check fiddler logs? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#106 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AMuI2vbh9k-KBG3TkCfZqWCnpyFPrImDks5s62yNgaJpZM4Qshu4>.

[hovsepm]

@abhi1509 Target framework? Do you install rollup package or just ResourceManager.Fluent?

[hovsepm]

@abhi1509 I have a repro. Seems like nuget manager is broken on VS2015. I've opened the same project in VS2017 and was able to add v1.4 reference.

[abhi1509]

great. thanks!

target framework is 4.5.2

What about the deadlock? is it fixed in 1.4?

[hovsepm]

I'll need a repro for that as well. Could you post your code here (excluding sensitive data if any)?

[abhi1509]

https://github.com/abhi1509/fluentSdkRmGenericResourceDeadlock/tree/master/WebApplicationRepro.Tests
run the test TestStuckGenericResourcesCheckExistence

[hovsepm]

No repro.
On my dev box (win10, VS2015 update 3) Your solution actually checks in a loop that SimpleWinVM is created but constantly receives 404 back.

it does not hang here - https://github.com/abhi1509/fluentSdkRmGenericResourceDeadlock/blob/master/WebApplicationRepro/AzureResourceManager.cs#L110

but actually sends /resourcegroups/temp1234/providers/Microsoft.Compute//virtualMachines/SimpleWinVM?api-version=2016-04-30-preview HTTP/1.1
receives HTTP/1.1 404 Not Found
and never exits the while loop.

[abhi1509]

given that we started a deployment, the VM should eventually exist and then we should exit the loop. once the VM is there, this gets stuck. I have noticed that it works fine if resource is not there.

[abhi1509]

@hovsepm Please let me know if you can't repro it. Basically if you query for a resource which already exists, it gets deadlocked.

[hovsepm]

@abhi1509 ok I got the repro and it is not a dead lock. SDK 3 times tries to query existence while Azure responds "503 Service Unavailable". Each retry has it's own wait time so that is why you see delays. This has nothing to do with the SDK but with the back end service.

[hovsepm]

@abhi1509 I've contacted service team for clarification.

[abhi1509]

Thanks. How long is the wait time. I modified the sample template so it now generates random dns names. otherwise the resource would never be created as there was a DNS conflict.

With the change, even when the VM is created, i still get TaskCancelledException after a long wait.

[hovsepm]

@abhi1509 it seems to be not supported by Compute Service. Their suggested workaround for now is use Get instead of Head (CheckExistence) operation.
FYI, I've published v.1.4.1 with VS2015 issue fix.