Assertion `srcIndex < srcSelectDimSize` failed.

[huggingface]

Assertion `srcIndex < srcSelectDimSize` failed.

[thomwolf]

It seems like a failed resource allocation.
Maybe you don't have enough RAM or your GPU is too small ?

[thomwolf]

Your log is very hard to read. Can you format it cleanly?

[SparkJiao]

I'm so sorry
The first error log is as follows:

/opt/conda/conda-bld/pytorch_1532584813488/work/aten/src/THC/THCTensorIndex.cu:362: void indexSelectLargeIndex(TensorInfo<T, IndexType>, TensorInfo<T, IndexType>, TensorInfo<long, IndexType>, int, int, IndexType, IndexType, long) [with T = float, IndexType = unsigned int, DstDim = 2, SrcDim = 2, IdxDim = -2, IndexIsMajor = true]: block: [11,0,0], thread: [95,0,0] Assertion \`srcIndex < srcSelectDimSize\` failed.

And then the Traceback finally points to line 1026 torch/nn/functional.py in linear:
output = input.matmul(weight.t())
It seems that somewhere crashed while using torch.index_select() , do you think it is because my sentence is too long? I will check other aspects, thank you very much

[SparkJiao]

My GPU has 12400 MB and I think that's enough, may be I should use 'yield' to input the data one by one? I will load less data to try, thanks u a lot!

[thomwolf]

Ok feel free to re-open the issue if you still have troubles.

[zyfedward]

Hi @SparkJiao

I met the same issue here, how did you resolve this?

[nv-quan]

I have the same issue, did you resolve this? @zyfedward @SparkJiao

[LysandreJik]

@nv-quan, do you mind opening a new issue with the template so that we may help?

[SparkJiao]

I have forgot how to reproduce the problem but the index_select error usually happened due to wrong index. You can use a smaller batch size and run the script on CPU to check the full traceback since the traceback while using GPU is delayed.