如何在Java中调用多个rest api并行?

时间:2018-05-15 08:49:33

标签: java rest apache-httpasyncclient

在Java中调用多个api并行的最佳方法是什么?我想做多个休息调用,合并结果并返回一个jsonArray。当我从一台客户端PC访问url时,我正在使用ExecutorService并获得正确的输出。但是当我从多个客户端访问url时,每次我得到不同大小的jsonArray,即使我正在调用相同的url。

我所做的事情如下:

ExecutorService executor = Executors.newFixedThreadPool(5); 
resultArray = new JSONArray();
for (Branch branch : Branches) {
    Future<Response> response = executor.submit(new Request(branch.getUrl(), 
      branch.getUserName(), branch.getPassword()));
    responseBody = response.get().getResponseBody();
    resultArray.put(responseBody);
}
executor.shutdown();
while(!executor.isTerminated()) {

}
return resultArray.toString();


public class Request implements Callable<Response> {

private HttpURLConnection con;
private URL obj;
private String response;

private String url;
private String username;
private String password;

public Request(String url, String username, String password) {
    this.url = url;
    this.username = username;
    this.password = password;
}

@Override
public Response call() {
    try {
        obj = new URL(url);
        con = (HttpURLConnection) obj.openConnection();
        String userCredentials = username + ":" + password;
        String basicAuth = "Basic " + java.util.Base64.getEncoder().encodeToString(userCredentials.getBytes());
        con.setRequestProperty ("Authorization", basicAuth);
        con.setRequestMethod("GET");

        int responseCode = con.getResponseCode();
        if(responseCode == 200) {
            BufferedReader in = new BufferedReader(new InputStreamReader(con.getInputStream()));
            String inputLine;
            StringBuffer stringBuffer = new StringBuffer();

            while ((inputLine = in.readLine()) != null) {
                stringBuffer.append(inputLine);
            }
            in.close();
            response = stringBuffer.toString();
            return new Response(responseCode, response);
        }
        else {
            response = "{\"response\":\"some error occurred\"}";
            return new Response(responseCode, response);
        }

    } catch (IOException e) {
        response = "{\"output\":\"some error occurred\"}";
        return new Response(404, response);
    }
}
}

public class Response {

private String responseBody;
private int responseCode;

public Response(int responseCode, String responseBody) {
    this.responseBody = responseBody;
    this.responseCode = responseCode;
}

public int getResponseCode() {
    return responseCode;
}

public String getResponseBody() {
    return responseBody;
}
}

1 个答案:

答案 0 :(得分:2)

请检查,

Collection<Callable<Request>> tasks = new ArrayList<>();
for (Branch branch : Branches) {
    tasks.add(new Request(branch.getUrl(), branch.getUserName(), branch.getPassword()));
}

int numThreads = Branches.size() > 4 ? 4 : Branches.size();
ExecutorService executor = Executors.newFixedThreadPool(numThreads);
List<Future<Response>> results = executor.invokeAll(tasks);
for(Future<Response> response : results){
    responseBody = response.get().getResponseBody();
    resultArray.put(responseBody);
}

从Java 7开始,您可以尝试用ForkJoin Pool替换ExecutorService,

Collection<Callable<Request>> tasks = new ArrayList<>();
for (Branch branch : Branches) {
    tasks.add(new Request(branch.getUrl(), branch.getUserName(), branch.getPassword()));
}

int numThreads = Branches.size() > 4 ? 4 : Branches.size();
ForkJoinPool pool = new ForkJoinPool(Runtime.getRuntime().availableProcessors());
List<Future<Response>> results = pool.invokeAll(tasks);
for(Future<Response> response : results){
    responseBody = response.get().getResponseBody();
    resultArray.put(responseBody);
}

注意:-该代码未经测试,几个月前我已经使用过类似的东西。