将Dec解码为真实角色

时间:2012-10-31 18:33:03

标签: xml unicode

当我从twitter的Stream API读取数据然后写入xmlfile时。

但像�这样的特殊字符会导致错误(我的意思是当我在Chrome中打开xmlfile时,Chrome会说该字符出错了!)

我想在写入xmlfile之前将编码序列(�)转换为真实字符( )!

如何实现?

------------- ADDED --------------

这是XMLFile内容:

<?xml version="1.0" encoding="UTF-8"?>
<root>
<text>@carlyraejepsen would be a dream if you follow me, please follow me?, I love you so much you're my inspiration</text>
<text>someone please bring me a caramel apple and a mocha from black cat. i'll love you forever</text>
<text>“@G_MartinFlyKick: Marry me Juliet.I love you and that's all I really know.”&#55357;&#56834;&#55357;&#56834;&#55357;&#56834;&#55357;&#56834;&#55357;&#56834;</text>
<text>"I need to see a picture of him cuz Im trying to imagine you guys making love and all I see is u climbing on top of a big question mark"lmao</text>
<text>@District3music hi, I LOVE YOU follow me please? &amp;lt;3 xx 23</text>
<text>RT @syardley_: So appreciative of my family and people I love, wouldn't be where I am without them. #thankful</text>
<text>#DISTRICT3HALLOWEENFOLLOWSPREE #DISTRICT3HALLOWEENFOLLOWSPREE #3EEKERFROMTHENETHERLANDS love you! Please follow ? @District3music x42</text>
<text>Arguably my favorite electronic music producer @Kluteuk is coming back to Toronto on Dec 22nd. So stoked. Guy has made so many tunes I LOVE.</text>
<text>The stakes are high, the water's rough, but this love is ours.</text>
<text>@NiallOfficial Answer me, I love you very much. Venezuela loves. jhgj</text>
<text>Love this shit http://t.co/qSP79NKx</text>
</root>

以下是Chrome的错误:

This page contains the following errors:

error on line 5 at column 91: xmlParseCharRef: invalid xmlChar value 55357
Below is a rendering of the page up to the first error.

2 个答案:

答案 0 :(得分:14)

字符引用&#55357;表示代理代码点(U + D83D),因此尝试将其转换为字符是错误的。它不是一个角色,甚至不是半个角色。

您需要追溯到生成引用的位置。原因可能是字符编码混乱。在UTF-16中,可以出现代理代码单元,但是当数据被解释为字符时,必须成对处理。转换为另一种编码或转向字符引用。

答案 1 :(得分:0)

您可以在服务器响应后使用正则表达式替换它。 python中的简单示例:

import re 
pattern = re.compile(r'&#')
new_content = pattern.sub(' ', SERVER_RESPONSE)