Bulk unload from redshift async

Question

I want to fire an unload query to redshift. But is using jdbc connection for doing this is the best way to go around?

As far as i have done my POC the call is blocking. Now many things can go wrong here, maybe the query dumps too much result and the jdbc connection may timeout.

So is there anyway in which we can submit a query to red shift asynchronously and then poll the api to see the result of the query.

PS: Using jdbc is not the only requirement. But the thing is the redshift should be connected by JAVA code

EDIT : Then if anyone has to fire a long running unload query what is the best way to go around ?

Answer 1

Redshift目前没有“提交和投票结果”功能。

我建议使用工作流服务器。可以运行工作并跟踪成功和失败的东西。

查看AWS Data Pipeline，Apache Airflow或Azkaban