Question

我正在运行一个地图缩小工作，它会映射大约100k条记录。

地图步骤在几千条记录（每次不同的地方）后失败，并在应用程序引擎日志中出现以下错误 BadValueError：名称必须小于500

管道工作ID：baada59c857d11e28527e1efd5a519d7

输出Blob文件名：content_contributors_report_1362478582.csv

日志转储

 Final result for job '1581739058957C0CA88F5' is 'success' E2013-03-05
 12:25:21.637 name must be under 500 bytes. Traceback (most recent call
 last):   File
 "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
 line 1535, in __call__
     rv = self.handle_exception(request, response, e)   File "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
 line 1529, in __call__
     rv = self.router.dispatch(request, response)   File "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
 line 1278, in default_dispatcher
     return route.handler_adapter(request, response)   File "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
 line 1102, in __call__
     return handler.dispatch()   File "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
 line 572, in dispatch
     return self.handle_exception(e, self.app.debug)   File "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py",
 line 570, in dispatch
     return method(*args, **kwargs)   File "/base/data/home/apps/s~myap/a-276.365486148015822746/mapreduce/base_handler.py",
 line 68, in post
     self.handle()   File "/base/data/home/apps/s~myapp/a-276.365486148015822746/mapreduce/handlers.py",
 line 437, in handle
     spec, state, self.base_path())   File "/base/data/home/apps/s~myapp/a-276.365486148015822746/mapreduce/handlers.py",
 line 517, in _finalize_job
     mapreduce_spec.mapper.output_writer_class().finalize_job(mapreduce_state)
 File
 "/base/data/home/apps/s~myapp/a-276.365486148015822746/mapreduce/output_writers.py",
 line 454, in finalize_job
     files.blobstore.get_blob_key(filename)))   File "/base/data/home/apps/s~myapp/a-276.365486148015822746/mapreduce/lib/files/blobstore.py",
 line 112, in get_blob_key
     _BLOB_FILE_INDEX_KIND, ticket, namespace='')])[0]   File "/python27_runtime/python27_lib/versions/1/google/appengine/api/datastore_types.py",
 line 504, in from_path
     ValidateString(id_or_name, 'name')   File "/python27_runtime/python27_lib/versions/1/google/appengine/api/datastore_types.py",
 line 176, in ValidateString
     raise exception('%s must be under %d bytes.' % (name, max_len)) BadValueError: name must be under 500 bytes.

Answer 1

不同版本的mapreduce可能会导致此问题。基于Run Map Reduce on non-default versions? 它建议使用https://code.google.com/p/appengine-mapreduce/

文档中陈旧的捆绑链接是一个错误。那会被清理干净   很快。

我们的一些SDK中有一些MapReduce（出于历史原因），但是   开源版本是现在的方法。

Mapreduce作业随机失败，出现'BadValueError：name必须低于500'

1 个答案: