Multiple Languages

[pemistahl]

Multiple Languages

[pemistahl]

@kazuser I think I've fixed the underlying problem now. Will be part of the next release.

[pchr8]

For completeness - I can reproduce this with

"Das ist mein Text, mit lange deutsche Wörter. Here is my text, it's clearly english text. Ось це мій текст.\n\n-\n\n\tSome more text.\n\nStop processing here - \n\n\nEND OF TEXT."

Stops at the - in 1.3.2, but works nicely in the 2-days-old 1.3.3!

[kazuser]

And another (empty) one:

from lingua import Language, LanguageDetectorBuilder
languages = [Language.ENGLISH, Language.KAZAKH, Language.RUSSIAN]
detector = LanguageDetectorBuilder.from_languages(*languages).build()
sentence = 'V төзімділік спорт'
for result in detector.detect_multiple_languages_of(sentence):
  print(f"{result.language.name} {sentence[result.start_index:result.end_index]}")

[kazuser]

Maybe something is wrong with the order? 😕