Accessing the `device` attribute of bias terms of `TransformerEncoderLayer` initialized with `bias = False` causes Attribute error

[beekill95]

Accessing the `device` attribute of bias terms of `TransformerEncoderLayer` initialized with `bias = False` causes Attribute error

[tringwald]

Seems to be a duplicate of #116385.

[beekill95]

These lines may be troublesome as well because they access the bias terms, which might or might not exist depending on whether the layer initialized with bias or not.

[ayush0x00]

Hey @beekill95 can you provide code snippet where you are getting the error?

[beekill95]

I just checked that the problem is fixed with the latest torch version. Feel free to close this issue.