tmxt's Introduction

tmxt

This tool consists on two scripts:

tmxplore.py, a script to determine the language codes available inside a particular TMX file by looking to an excerpt or even the whole file.
tmxt.py, to effectively transform a TMX to a tab-separated text file using the language code list provided in the command. TU propierties can also be printed if requested.

Requirements

Requires python3 and the libraries included in requirements.txt

Examples of usage

`tmxplore.py`

$ python3 tmxplore.py file.tmx
en es

$ cat file.tmx | python3 tmxplore.py
en es

`tmxt.py`

$ python3 tmxt.py --codelist en,fr tm.fr-en.tmx en-fr.txt

Other

$ zcat largefile.tmx.gz | python3 tmxt.py --codelist en,es |gzip > bitext.en-es.gz

Printing TU propierties

$ python3 tmxt.py --codelist en,fr,prop1,prop2 tm.fr-en.tmx en-fr.txt

tmxt's People

Contributors

Stargazers

Watchers

tmxt's Issues

Incorrect output on multilingual TMX files

The Khresmoi TMX file from https://elrc-share.eu/repository/download/4a377a8c0a2811e9b7d400155d026706eba6a605cd32407d9216ad32f64e398e/

looks like

<?xml version="1.0" encoding="utf-8"?>
<tmx version="1.4">
        <header creationtool="WB_Python" creationtoolversion="1.0" o-tmf="WB" segtype="sentence" adminlang="en-GB" srclang="en-GB" datatype="xml" creationdate="20181205T073750Z">
        </header>
        <body>
                <tu tuid="1" srclang="en-GB">
                        <tuv xml:lang="en-GB">
                                <seg>The aim of this study was to investigate the effect of in vivo inhibition of factor XI and TAFI in an experimental thrombosis model in rabbits.</seg>
                        </tuv>
                        <tuv xml:lang="de-DE">
                                <seg>Das Ziel dieser Studie war die Erforschung der Auswirkung einer in-vivo-Hemmung von Faktor XI und TAFI in einem experimentellen Thrombose-Modell bei Kaninchen.</seg>
                        </tuv>
                </tu>
                <tu tuid="2" srclang="en-GB">
                        <tuv xml:lang="en-GB">
                                <seg>The aim of this study was to investigate the effect of in vivo inhibition of factor XI and TAFI in an experimental thrombosis model in rabbits.</seg>
                        </tuv>
                        <tuv xml:lang="fr-FR">
                                <seg>Le but de cette étude était d"étudier l'effet de l'inhibition in vivo de facteur XI et TAFI dans un modèle expérimentale de thrombose chez les lapins.</seg>
                        </tuv>
                </tu>

and this tool is producing The aim of this study was to investigate the effect of in vivo inhibition of factor XI and TAFI in an experimental thrombosis model in rabbits. repeatedly with blank German when another language appears.

Writing different language to different files or chunks of file

Hi there,

Thanks for creating such a wonderful tool! I was wondering if it is possible to write to separate txt files based on language codes, or write them into different chunks of text (instead of \t separated)?

Best

Recommend Projects