goerz/convert_encoding.py

Python script for converting text files between encodings (stable)

convert_encoding.py

http://github.com/goerz/convert_encoding.py

Author: Michael Goerz

Convert text files between arbitrary encodings and line endings.

This code is licensed under the GPL

Install

Store the convert_encoding.py script anywhere in your $PATH.

Usage

convert_encoding.py [options] file1 file2 ...

Options are:
    -f enc,  --from=enc    the input encoding
                           (default: locale.getpreferredencoding())
                           Set this to 'guess' if the encoding is unknown.
    -t enc,  --to=enc      the output encoding
                           (default: locale.getpreferredencoding())
    -e code, --eol=code    the end-of-line mode (see below)
    -o file, --out=file    where to write the converted data. Conversion is
                           done in-place if this is omitted
    -n, --nocodec          ignore input and output encoding, just process eol
    -r, --recursive        go into directories recursively
    -l, --followlinks      follow symbolic links
    -d, --dotfiles         in combination with -r: process files that begin
                           with a dot, if they are found in a directory reached
                           by recursion. You still have to specify dotfiles
                           explicitly in the initial filelist.
    -q, --quiet            don't display warnings or status messages

For valid encoding names, see
https://docs.python.org/2.4/lib/standard-encodings.html

Accepted values for the eol code are: 'unix', 'linux', 'dos', 'win', 'mac'.
If you do not specify an end-of-line, it will be set to your system's default,
regardless of the original end-of-line.

Any '#' in the out-filename will be replaced with the full name of the input
file.

Note that guessing the input encoding is not foolproof in any way. Always
provide an explicit input encoding if you can.

The program supports full unix style globbing on all operation systems,
independently of your shell's capabilities. Also, environment variables
and '~' will be expanded following the usual conventions.

The file may also be used as a module from python.

convert_encoding.py's Issues

The script converts case to lowercase in Windows

For example, I convert java file like "test/FileTools.java". I call
python convert_encoding.py -f windows-1251 -t utf-8 -e win -r src
and get result "test/filetools.java". For java, groovy and similar projects this is bad as they use CamelCase.