The rtoss from tasukus

View Code? Open in Web Editor NEW

Automatically exported from code.google.com/p/rtoss

C++ 12.56% C 83.15% PHP 0.75% CSS 0.02% Perl 0.66% Batchfile 0.01% Makefile 0.63% Shell 0.64% NSIS 0.05% Java 0.61% HTML 0.15% Smarty 0.09% Perl 6 0.05% Objective-C 0.17% TeX 0.29% Groff 0.15% Tcl 0.01% Logos 0.01% XSLT 0.01% PLpgSQL 0.01%

rtoss's People

Contributors

Watchers

rtoss's Issues

GB18030 support for GreenPad

What steps will reproduce the problem?
1. Open any text file encoded in GB18030 with 4-byte char sequences.
2. Auto detect file encoding.


What is the expected output? What do you see instead?
It is expected to decode the file as GB18030 or GBK.
GreenPad decodes the file as Shift-JIS or Turkish.


What version of the product are you using? On what operating system?
SVN revision 166. XP SP3.


Please provide any additional information below.
I have made local modifications to use CP54936 instead of CP936 for Chinese 
text, and implemented CharNext and detection for GB18030, as the M$ Windoze API 
sucks. Here is the patch attached.

It seems to work in my test cases, but I hope anyone could conduct more 
thorough tests to make it robust enough for merging into mainstream hopefully.

However the patch has one known problem, that 1-byte Euro sign (0x80) in CP936 
no longer works in CP54936. Maybe it would be a better solution to separate GBK 
and GB18030 handling routines.

Original issue reported on code.google.com by [email protected] on 1 Jan 2011 at 6:37

Attachments:

Recommend Projects