Internationalise stop_words

[juliasilge]

Internationalise stop_words

[Ironholds]

Argh. So it looks like the other language variants of the initial dictionary are (1) not freely accessible and (2) just google translate :|. Any objections to using different corpora for the non-en stopwords?

[juliasilge]

We are putting internationalization work on hold until after our next CRAN release (0.1.3) and will start it heading toward 0.1.4.

[Ironholds]

Makes sense.

[cschwem2er]

Hi,
why don't you make use of @kbenoit 's quanteda multi language capabilities? They have, for instance, several language specific stop word lists.

[juliasilge]

@methodds Thanks again for the suggestion. This was implemented in commit 991c4df.

[kbenoit]

Note that the upcoming CRAN refresh of quanteda will move to reliance on the stopwords package, implemented in quanteda/quanteda#1159.

This has international stopwords but also bases its core on a principled set, the Snowball list. (It also includes the more inclusive “stopwords-iso” list for about 57 languages, which has wider coverage but is not very systematically collected.)

[juliasilge]

Wow, thanks, @kbenoit.

[github-actions]

This issue has been automatically locked. If you believe you have found a related problem, please file a new issue (with a reprex: https://reprex.tidyverse.org) and link to this issue.