bias is not randomly initialized on metal

[michael8090]

bias is not randomly initialized on metal

[tomsanbear]

Looks like this might answer your question #1959 (comment)

[tomsanbear]

Tested out locally and could reproduce on version 0.4.1, however this appears to have been fixed in recent commits. In the meantime until 0.4.2 is released I'd suggest this change to your cargo to track the git repository for now like below:

[dependencies]
candle-core = { git = "https://github.com/huggingface/candle", features = [
    "metal",
] }
candle-nn = { git = "https://github.com/huggingface/candle", features = [
    "metal",
] }

[michael8090]

Thanks.
I just tried the latest code on git, and the bias seems random, but it seem using a pseudorandom algorithm, because everytime I re-run the program, the output is always the same. In another word, the program is deterministic on metal. While on CPU, it's not.

Is that exepected?

[michael8090]

Thanks for the info.