Comments (6)
@TomLucidor I'm currently writing Python bindings for the Rust implementation which will eventually replace the pure Python implementation. This will solve most performance issues.
from lingua-py.
Hi @astuanax, thanks for your request.
I'm planning to add 25 more languages to Lingua so that it supports a total of 100 languages then. I'm pretty sure that Maltese and Luxembourgish will be among those new languages. It may take a while, however.
Before starting that, I will first evaluate whether it's possible to use the Rust port of Lingua within Python because the pure Python port is actually very slow. The Rust port is significantly faster.
from lingua-py.
Hello @pemistahl
will there be Occitan and Kabyle languages in your 100 new supported languages?
Best regards
from lingua-py.
Hi @Mejans, I won't add a set of 100 new languages. I was talking about 25 new languages. That's far enough work for now.
I haven't decided yet which languages to include but I'm in favor of including some minority languages as well. So thank you for proposing Occitan and Kabyle. I will keep them in mind.
from lingua-py.
Sure, I understand, let me know if I can help with testing.
from lingua-py.
@pemistahl can ML libraries accelerate Python's performance?
from lingua-py.
Related Issues (20)
- `compute_language_confidence_values_in_parallel` crashes with big dataset HOT 11
- Offsets incorrect HOT 4
- Can you release the Python source code?
- Language recognition fails for programming language code HOT 8
- Add type annotations to v2.x HOT 3
- Convert language to ISO 639-1 language code HOT 4
- TypeError: cannot pickle `Language` object with v2.0.1 HOT 4
- ISO Codes
- CHINESE detect error HOT 5
- Crash on particular emoji with detect_multiple_languages HOT 3
- detect_multiple_languages_of crashes on Arabic HOT 1
- Yanked versions HOT 4
- Readme file too long for Azure Artifacts HOT 6
- Add v2+ support for Alpine Linux by providing `musllinux` wheels HOT 5
- High-confidence false detections on text from webpages that contain many languages HOT 1
- detect_multiple_languages_of() does not work at all for mixed English, Chinese and Japanese HOT 3
- Single word greeting detection issue HOT 3
- Cannot convert IsoCode or language string into the actual type
- Accuracy comparision between lingua and fasttext HOT 3
- Multiple Function result discrepancy
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lingua-py.