Question

我有一个格式错误的字符串，可能是由MySQL JDBC驱动程序的 bug 引起的，

示例格式错误的字符串（malformed_string.getBytes("UTF-8")）的字节是：

C3 A4 C2 B8 C2 AD C3 A6 E2 80 93 E2 80 A1  (UTF-8 twice)

应编码以下字节（它已经是UTF-8编码，但将它们视为ISO-8859-1编码）

----- ----- ----- ----- -------- --------
  E4   B8    AD     E6     96       87     (UTF-8)

应编码以下Unicode BigEndian字节

---------------     ---------------------
     4E 2D                65 87            (Unicode BigEndian)

我想将第一个解码为第二个，我尝试new String(malformed_string.getBytes("UTF-8"), "ISO-8859-1")，但它没有按预期转码。我想知道是否有像byte[] encode/decode (byte[] src, String charsetName)这样的东西，或者如何在java中实现上面的转码？

背景

我有一个具有中文列名的MySQL表，当我用长数据更新这些列时，MySQL JDBC驱动程序抛出了这样的异常：

com.mysql.jdbc.MysqlDataTruncation: Data truncation: Data too long for column 'ä¸æ–‡' at row 1

例外中的列名称格式不正确，应为“中文”，并且必须正确显示给用户，如下所示。

com.mysql.jdbc.MysqlDataTruncation: Data truncation: Data too long for column '中文' at row 1

修改

这是MySQL语句，用于演示如何发生格式错误的字符串，以及如何将其恢复为正确的字符串

show variables like 'char%';
+--------------------------+--------------------------+
| Variable_name            | Value                    |
+--------------------------+--------------------------+
| character_set_client     | utf8                     |
| character_set_connection | utf8                     |
| character_set_database   | utf8                     |
| character_set_filesystem | binary                   |
| character_set_results    | utf8                     |
| character_set_server     | utf8                     |
| character_set_system     | utf8                     |
| character_sets_dir       | C:\mysql\share\charsets\ |
+--------------------------+--------------------------+

-- encode
select
    hex(convert(convert(unhex('E4B8ADE69687') using UTF8) using ucs2)) as `hex(src in UNICODE)`,
    unhex('E4B8ADE69687') `src in UTF8`,
    'E4B8ADE69687' `hex(src in UTF8)`,
    hex(convert(convert(unhex('E4B8ADE69687') using latin1) using UTF8)) as `hex(src in UTF8->Latin1->UTF8)`;
+---------------------+-------------+------------------+--------------------------------+
| hex(src in UNICODE) | src in UTF8 | hex(src in UTF8) | hex(src in UTF8->Latin1->UTF8) |
+---------------------+-------------+------------------+--------------------------------+
| 4E2D6587            | 中文        | E4B8ADE69687     | C3A4C2B8C2ADC3A6E28093E280A1   |
+---------------------+-------------+------------------+--------------------------------+
1 row in set (0.00 sec)


-- decode
select
    unhex('C3A4C2B8C2ADC3A6E28093E280A1') as `malformed`,
    'C3A4C2B8C2ADC3A6E28093E280A1' as `hex(malformed)`,
    hex(convert(convert(unhex('C3A4C2B8C2ADC3A6E28093E280A1') using utf8) using latin1)) as `hex(malformed->UTF8->Latin1)`,
    convert(convert(convert(convert(unhex('C3A4C2B8C2ADC3A6E28093E280A1') using utf8) using latin1) using binary)using utf8) `malformed->UTF8->Latin1->binary->UTF8`;
+----------------+------------------------------+------------------------------+---------------------------------------+
| malformed      | hex(malformed)               | hex(malformed->UTF8->Latin1) | malformed->UTF8->Latin1->binary->UTF8 |
+----------------+------------------------------+------------------------------+---------------------------------------+
| ä¸æ–‡         | C3A4C2B8C2ADC3A6E28093E280A1 | E4B8ADE69687                 | 中文                                  |
+----------------+------------------------------+------------------------------+---------------------------------------+
1 row in set (0.00 sec)

Answer 1

查看本教程：http://download.oracle.com/javase/tutorial/i18n/text/string.html

妙语是仅使用jdk类进行转码的方式：

try {
byte[] utf8Bytes = original.getBytes("UTF8");
byte[] defaultBytes = original.getBytes();

String roundTrip = new String(utf8Bytes, "ISO-885-9");
System.out.println("roundTrip = " + roundTrip);
System.out.println();
printBytes(utf8Bytes, "utf8Bytes");
System.out.println();
printBytes(defaultBytes, "defaultBytes");
} catch (UnsupportedEncodingException e) {
 e.printStackTrace();
}

对于更强大的转码机制，我建议您查看ICU＆gt;

如何使用Java直接使用charset对字节数组进行编码/解码/转码

1 个答案: