AllegroGraph - N-Triples中的UTF-8字符

时间:2012-06-11 19:52:53

标签: python unicode utf-8 allegrograph

当我使用AllegroGraph 4.6 Python API时,我可以使用connection.addTriple()方法尝试添加以包含unicode字符(×)的文字结尾的三元组:

conn.addTriple( ..., ..., '5 × 10**5' )

这不起作用。我收到错误:

UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position...

这是完整的追溯:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/openrdf/repository/repositoryconnection.py", line 357, in addTriple
    self._convert_term_to_mini_term(obj), cxt)
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/openrdf/repository/repositoryconnection.py", line 235, in _convert_term_to_mini_term
    return self._to_ntriples(term)
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/openrdf/repository/repositoryconnection.py", line 367, in _to_ntriples
    else: return term.toNTriples();
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/openrdf/model/literal.py", line 182, in toNTriples
    sb.append(strings.encode_ntriple_string(self.getLabel()))
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/openrdf/util/strings.py", line 52, in encode_ntriple_string
    string = unicode(string)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 18: ordinal not in range(128)

相反,我可以像这样添加三元组:

conn.addTriple( ..., ..., u'5 × 10**5' )

这样我就不会收到错误。

但是如果我使用connection.addFile(filename, format=RDFFormat.NTRIPLES)加载包含一些UTF-8编码字符的ntriples文件,如果ntriples文件从Notepad ++保存为ANSI编码,则会收到此错误消息:

400 MALFORMED DATA: N-Triples parser error while parsing
#<http request stream @ #x10046f9ea2> at line 12764 (last character was
#\×): nil
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/openrdf/repository/repositoryconnection.py", line 341, in addFile
    commitEvery=self.add_commit_size)
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/miniclient/repository.py", line 342, in loadFile
    nullRequest(self, "POST", "/statements?" + params, body, contentType=mime)
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/miniclient/request.py", line 198, in nullRequest
    if (status < 200 or status > 204): raise RequestError(status, body)
franz.miniclient.request.RequestError: Server returned 400: N-Triples parser error while parsing

如果文件保存为UTF-8编码,则会收到此错误消息:

400 MALFORMED DATA: N-Triples parser error while parsing
#<http request stream @ #x100486e8b2> at line 1 (last character was
#\): Subjects must be resources (i.e., URIs or blank nodes)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/openrdf/repository/repositoryconnection.py", line 341, in addFile
    commitEvery=self.add_commit_size)
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/miniclient/repository.py", line 342, in loadFile
    nullRequest(self, "POST", "/statements?" + params, body, contentType=mime)
  File "/cygdrive/c/agraph-4.6-client-python/src2/franz/miniclient/request.py", line 198, in nullRequest
    if (status < 200 or status > 204): raise RequestError(status, body)
franz.miniclient.request.RequestError: Server returned 400: N-Triples parser error while parsing

但是,如果在Notepad ++中将文件设置为ANSI编码,我可以进入并粘贴×字符,保存,然后文件加载正常。或者,如果我在粘贴字符后将文件编码更改为UTF-8,则该字符将更改为某个奇怪的xD7字符。如果文件设置为UTF-8编码并且我将×粘贴到那里,那么如果我将编码更改为ANSI,则×会更改为×

当文件发给我时,×应该有×,当我试图在AllegroGraph中加载它时,我得到了第一个400 MALFORMED DATA错误,字符实际出现在文件中的行(12764),而不是仅在第一行。我假设我在第1行得到第二个400 MALFORMED DATA错误的原因与Notepad ++为UTF-8编码文件写的标题有关。显然,如果我希望AllegroGraph不立即打嗝,我必须将文件保存为ANSI,但必须有一些方法告诉AllegroGraph将×之类的内容读作UTF-8字符。

在文件中,三元组看起来像:

<...some subject URI...> <...some predicate URI...> "5 × 10**5" .

2 个答案:

答案 0 :(得分:1)

使用编解码器模块。

import codecs
f = codecs.open('file.txt','r','utf8')

这将打开强制utf8编码的文件

答案 1 :(得分:1)

\xd7×的Latin-1编码。

×是你错误地将×解码为cp1252(通常是Windows的默认编解码器),如果它是用UTF-8编码的话。

当您获得显示×的文件时,请尝试将用于显示它们的编解码器更改为UTF-8。


有关Python中Unicode的概述,请参阅here。 〜感谢Daenyth。


正如您从AllegroGraph支持中发现的那样:

  

AllegroGraph可以使用\ uXXXX在nTriples中获取unicode字符   符号。或者,可以使用RDFXML,它允许您离开   unicode字符,因为它们。