Pipeline Timeout Error when training using Google AutoML

Question

Previously I successfully trained my small dataset using Google AutoML with decent accuracy. Now I want to train another dataset with 999.683 images (nearly the limit of images in 1 dataset) spread in 28 classes.

The training process took a very long time, after 24 hour of waiting Google sent me the error report

Due to an error, AutoML Vision was unable to process your dataset "My_Dataset". There will be no charge issued for this job.

And the error details on AutoML Vision only shows

Pipeline c350ef1471db4bdb800f743eef963aec timeout.

Anybody has experienced this? Is this the problem with my dataset? Or is it a problem on Google AutoML server side?

Answer 1

这是由于在非常大的训练数据集上使用免费版本（1节点小时）引起的。训练过程尚未完成，超过24小时就会抛出该错误。通过选择24 Node hour选项，它将继续训练过程而不会引发任何错误。

警告：

• 对于我近100万的数据集，我花了2到3天的时间收到来自Google的电子邮件，表明培训已经结束。
• 它用了我所有的300美元免费积分