kbatsuren/wiktra

Wiktra - Python tool of Wiktionary Transliteration modules for 514 languages and its 102 different scripts (orthographies)

wiktra's Issues

Linux dependencies (Linux Support)

Would the authors kindly provide instructions to install wikta on linux distros such as ubuntu etc?

Thanks in Advance.

missing file wikt.mw

lupa._lupa.LuaError: [string ""]:1: module 'wikt.mw' not found:
is raised when trying to import translite

Transliteration from Arabic not working for continuous text

Transliteration from Arabic is not working for continuous text. It works for single space-separated characters. The Arabic Wiktionary module is a bit complex, need to investigate and add some special processing.

Update to cover all Wiktionary transliterations?

How feasible would it be to update this to cover all Wiktionary transliterations, and possibly expose additional functionality?

1. Update to cover all transliteration modules: https://en.wiktionary.org/wiki/Category:Transliteration_modules

2. Change the API so we can specify the input ISO 639 language code and/or ISO 15924 script code, possibly only the ISO script code without specifying the language.

3. Change the API so we can optionally specify the output language and/or script code, so we can transliterate to other scripts/languages, not just Latin, using modules like https://en.wiktionary.org/wiki/Module:Newa-Deva-translit

4. It would be best that language and script lookups would be done using native Lua modules (see dependencies below)

5. Provide instructions or some script that automatically updates the Lua components from Wiktionary (I don’t know how this is done).

Possible dependencies

Integrate languages:

• https://en.wiktionary.org/wiki/Module:languages
• https://en.wiktionary.org/wiki/Module:languages/alldata
• https://en.wiktionary.org/wiki/Module:languages/byTranslitModule
• https://en.wiktionary.org/wiki/Module:wikimedia_languages
• https://en.wiktionary.org/wiki/Module:wikimedia_languages/data
• https://en.wiktionary.org/wiki/Module:languages/JSON
• https://en.wiktionary.org/wiki/Module:language-like
• https://en.wiktionary.org/wiki/Module:etymology_languages

Integrate families:

• https://en.wiktionary.org/wiki/Module:families
• https://en.wiktionary.org/wiki/Module:families/data

Integrate scripts:

• https://en.wiktionary.org/wiki/Module:scripts
• https://en.wiktionary.org/wiki/Module:scripts/data
• https://en.wiktionary.org/wiki/Module:scripts/by_name
• https://en.wiktionary.org/wiki/Module:scripts/code_to_canonical_name
• https://en.wiktionary.org/wiki/Module:scripts/print
• https://en.wiktionary.org/wiki/Module:writing_systems

Integrate translit-redirect/data

• https://en.wiktionary.org/wiki/Module:translit-redirect
• https://en.wiktionary.org/wiki/Module:translit-redirect/data

Dependencies:

• https://en.wiktionary.org/wiki/Module:JSON
• https://en.wiktionary.org/wiki/Module:debug
• https://en.wiktionary.org/wiki/Module:table

Missing wikt.mw — another take

A simpler way to solve the missing wikt.mw problem would be to add

import os
os.chdir(os.path.dirname(__file__))

at the beginning of Wiktra.py

Missing transliteration modules

If I try to transliterate Georgian text (e.g. wiktrapy -l geo -t მხედრული), I get the following error (abbreviating somewhat):

File "lupa/_lupa.pyx", line 280, in lupa._lupa.LuaRuntime.execute
  File "lupa/_lupa.pyx", line 1297, in lupa._lupa.run_lua
  File "lupa/_lupa.pyx", line 1306, in lupa._lupa.call_lua
  File "lupa/_lupa.pyx", line 1332, in lupa._lupa.execute_lua_call
  File "lupa/_lupa.pyx", line 1268, in lupa._lupa.raise_lua_error
lupa._lupa.LuaError: [string "<python>"]:1: module 'wikt.translit.Geor-translit' not found:
	no field package.preload['wikt.translit.Geor-translit']
	no file '/var/www/.local/lib/python3.9/site-packages/wiktra/wikt/translit/Geor-translit.lua'
	no file '/var/www/.local/lib/python3.9/site-packages/wiktra/wikt/wikt/translit/Geor-translit.lua'
	no file '/var/www/.local/lib/python3.9/site-packages/wiktra/wikt/translit/wikt/translit/Geor-translit.lua'
	no file '/var/www/.local/lib/python3.9/site-packages/wiktra/wikt/data/wikt/translit/Geor-translit.lua'
	no file '/var/www/.local/lib/python3.9/site-packages/wiktra/wikt/data/translit/wikt/translit/Geor-translit.lua'
	no file '/usr/local/lib/lua/5.3/wikt/translit/Geor-translit.so'
	no file '/usr/local/lib/lua/5.3/loadall.so'
	no file './wikt/translit/Geor-translit.so'
	no file '/usr/local/lib/lua/5.3/wikt.so'
	no file '/usr/local/lib/lua/5.3/loadall.so'
	no file './wikt.so'

Arabic transliteration module incompatible with Lua ≥5.2

In line 332 of wikt/translit/ar-translit.lua, unpack(sub) should be replaced with table.unpack(sub), otherwise Lua throws the error attempt to call a nil value (global 'unpack').

This may also be an issue with other transliteration modules, but I have not checked if there are any others that use unpack.

Hebrew transliteration not working

Hebrew text does not get transliterated, regardless of whether the input is a single letter or a whole word, and regardless of whether vowel marks are used or not. E.g. wiktrapy -l heb -t בְּרֵאשִׁ֖ית produces בְּרֵאשִׁ֖ית, and wiktrapy -l heb -t ת produces ת.