我可以使用自定义图像从命令行创建Google dataproc群集:
gcloud beta dataproc clusters创建cluster-name --image = custom-image-name
在https://cloud.google.com/dataproc/docs/guides/dataproc-images中指定,但我无法找到有关如何使用v1beta2 REST api执行相同操作的信息,以便从气流中创建群集。任何帮助将不胜感激。
答案 0 :(得分:0)
Since custom images can theoretically reside in a different project if you grant read/use access of that custom image to whatever project service account you use for the Dataproc cluster, images currently always need a full URI, not just a short name.
When you use gcloud, there's syntactic sugar where gcloud will resolve the full URI automatically; you can see this in action if you use --log-http
with your gcloud command:
gcloud beta dataproc clusters create foo --image=custom-image-name --log-http
If you created one with gcloud you can also gcloud dataproc clusters describe
your cluster to see the fully-resolved custom image URI.