我正在尝试通过运动学数据流传输rds,但这给了我这个错误:
botocore.exceptions.ClientError:发生错误 (ValidationException)调用PutRecord操作时:1 检测到验证错误:值 'arn:aws:kinesis:us-west-2:xxxxxxxxxx:stream / rds-temp-leads-stream'在 'streamName'无法满足约束:成员必须满足常规 表示模式:[a-zA-Z0-9 _.-] +
该如何解决?
import json
import boto3
from datetime import datetime
from pymysqlreplication import BinLogStreamReader
from pymysqlreplication.row_event import (
DeleteRowsEvent,
UpdateRowsEvent,
WriteRowsEvent,
)
class DateTimeEncoder(json.JSONEncoder):
def default(self, o):
if isinstance(o, datetime):
return o.isoformat()
return json.JSONEncoder.default(self, o)
def main():
mysql = {
"host": "",
"port":,
"user": "",
"passwd": "",
"db": ""}
kinesis = boto3.client("kinesis", region_name = 'us-west-2')
stream = BinLogStreamReader(
connection_settings = mysql,
server_id=100,
blocking = True,
log_file='mysql-bin.000003',
resume_stream=True,
only_events=[DeleteRowsEvent, WriteRowsEvent, UpdateRowsEvent])
for binlogevent in stream:
for row in binlogevent.rows:
print row
event = {"schema": binlogevent.schema,
"table": binlogevent.table,
"type": type(binlogevent).__name__,
"row": row
}
kinesis.put_record(StreamName="jhgjh", Data=json.dumps(event, cls=DateTimeEncoder), PartitionKey="default")
#print json.dumps(event)
if __name__ == "__main__":
main()
答案 0 :(得分:2)
从流名称中删除“ arn:aws:kinesis:us-west-2:xxxxxxxxxx:stream / rds-temp-leads-stream”。只需将流的名称放在那里,例如“ rds-temp-leads-stream”
答案 1 :(得分:1)
基于错误:
<块引用>检测到 1 个验证错误:“streamName”处的值“arn:aws:kinesis:us-west-2:xxxxxxxxxx:stream/rds-temp-leads-stream”未能满足约束条件:成员必须满足正则表达式模式:[a-zA-Z0-9_.-]+
突出显示的值:arn:aws:kinesis:us-west-2:xxxxxxxxxx:stream/rds-temp-leads-stream 与正则表达式 [a- zA-Z0-9_.-]+ 导致验证错误。
这是因为您无需添加完整的 ARN,只需添加流的名称即可。即 rds-temp-leads-stream
我没有在代码中看到它,但可能这一行出现了错误:
kinesis.put_record(StreamName="jhgjh", Data=json.dumps(event, cls=DateTimeEncoder), PartitionKey="default")
其中“StreamName”应遵循与上述相同的模式。可以在下面找到参考: https://docs.aws.amazon.com/kinesis/latest/APIReference/API_PutRecord.html
答案 2 :(得分:0)
就我而言,我还必须像这样删除地址中的子文件夹:
不正确
bucket='s3://image-video/image/'
photo='scene_academy.jpg'
client=boto3.client('rekognition')
response = client.detect_labels(Image={'S3Object':{'Bucket':bucket,'Name':photo}},
MaxLabels=10)
正确
bucket='image-video'
photo='image/scene_academy.jpg'
client=boto3.client('rekognition')
response = client.detect_labels(Image={'S3Object':{'Bucket':bucket,'Name':photo}},
MaxLabels=10)
运行时环境:AWS S3 存储桶