RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

[facebookresearch]

RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

[aiwinapp]

thx. I was fix it by adding converter to float32:

    self.weight = Parameter(self.weight.to(dtype=torch.float32))
    if self.bias is not None:
        self.bias = Parameter(self.bias.to(dtype=torch.float32))

[cbalioglu]

@konstik37 Unfortunately PyTorch lacks fp16 support for many CPU-based ops. If you have a CUDA-capable GPU available, I suggest running your code on device; otherwise, you should be able to run inference on CPU in fp32.

[cbalioglu]

@kauterry @cndn fyi

[Visne]

@konstik37 Where did you put this code?