the speed of reading onnx file gets slower by updating from 0.4 to 0.6.

[unity-technologies]

the speed of reading onnx file gets slower by updating from 0.4 to 0.6.

[FlorentGuinier]

Hi h-nakae, Barracuda 0.6.1 was just published. Along with it a performance regression was fixed. Could you give it a try please?

[h-nakae]

Hi FlorentGuinier ,
Thank you for your replying.
I have just tried the new version, but it seems that the speed is still slow unfortunately...

Here, I put the screen shot.
The left one is version0.4, the second is 0.6.
The speed is as follwing.

v0.4 ⇒ 29.0 FPS
v0.61 ⇒ 15.7FPS

Thank you for your helping.

[yukihiko]

Hi,
In the model I am using, the model layer was 145 layers in Ver0.4, 405 layers in Ver0.6.1, and there was a difference after loading the onnx model.
The layer added in Ver0.6.1. was of Type.Load.
This may be one of the reasons.
I do not understand what the data of Type.Load, but I tried put this code at the top of the loop in the ExecuteAsync method in GenericWorker.cs

if (l.type == Layer.Type.Load) continue;

The processing was improved from 23fps to 43fps.
(It is about 55fps in ver0.4)
At Type.Load, I don't know if PrepareStorage method is not needed.

[mantasp]

@yukihiko we managed to reproduce issue, we expect to ship fix in 0.6.2.
Thanks for reporting!

[yukihiko]

Thank you! I'm hoping for the next release.

[mantasp]

@yukihiko we just shipped 0.6.2, could you please check if your use case performance is back?

[yukihiko]

I tried ver.0.6.2.
It's a great job!
It became almost the same speed as ver.0.4.(I think ver.0.4 is about 1fps faster)
Thank you!

[h-nakae]

@mantasp , @FlorentGuinier

Thank you for the updating.
That is nice of you.

I'm satisfied with that so I will close this issue.
Thanks