The reason for using "[MASK]" to replace a masked word in the LIME method

[pair-code]

The reason for using "[MASK]" to replace a masked word in the LIME method

[bastings]

Hi! This is an open research question. LIME would go with the [UNK] token, but since many are using BERT-like models, which have seen the [MASK] token for an undefined input a lot more often (and almost no [UNK] tokens since it uses a WordPiece vocab), it seems to be a better choice. We would like to make this configurable because there is no single right option that works across all models.