node.js按域计算带宽使用情况

时间:2012-04-11 05:01:00

标签: node.js limit monitoring bandwidth

如何使用node.js作为Web服务器来监控每个域的带宽使用情况?

有没有人知道我没有遇到的API调用?

或其他人在多租户环境中使用的模块或其他方法,您需要按带宽收费?

更新

有没有人知道可以放在任何网络服务器(node.js,apache等)之前的轻量级代理/服务器,它可以通过检查域来记录这些带宽统计数据?

3 个答案:

答案 0 :(得分:4)

如果不修改node.js核心,最好的选择似乎是使用bytesRead和bytesWritten变量在套接字级别跟踪它。

这实际上比仅测量http请求/响应字符串的大小更准确,因为其他一些带宽跟踪器会计算传输的数据。

您有2个选项:1)记录每个请求的字节数或2)记录TCP连接上的字节数。

登录请求级别将提供可能有用的实时数据。但是,根据您实施日志记录的方式,它可能会减慢速度。最好将它保存在内存中,并经常将其转储到磁盘/数据库。

登录请求级别:

var http = require('http');
var server = http.createServer(function (req, res) {
  // setup a counter for bytes already logged
  req.connection.bytesLogged = (req.connection.bytesLogged || 0);

  // output the bytes read by the socket
  console.log('Socket [' + req.connection.remoteAddress + '] [' + req.headers.host + '] - Bytes Read: ' + req.connection.bytesRead);

  // calculate the bytes of the request (includes headers and other tcp overhead - more realistic)
  req.bytes = req.connection.bytesRead - req.connection.bytesLogged;
  // output the bytes size of the request (note this is calculated after the TCP packets have been collected from the network and parsed by the HTTP parser
  console.log('Request [' + req.connection.remoteAddress + '] [' + req.headers.host + '] - Bytes: ' + req.bytes);

  // log the bytes to a memory array, DB or disk (implementation not shown)
  // [code here]

  // add the request bytes to the counter
  req.connection.bytesLogged = req.connection.bytesLogged + req.bytes;

  // normal http server processing like return document or file
  res.writeHead(200, {'Content-Type': 'text/plain'});
  res.end('ok');
}).listen(1337, '127.0.0.1');
console.log('Server running at http://127.0.1.1:1337/');

记录套接字级别:

var http = require('http');
var server = http.createServer(function (req, res) {

  // create some variables for data we want to log
  //
  // due to the way node.js works the remoteAddress and remotePort will not
  // be available in the connection close event
  // we also need to store the domain/host from the http header because the http
  // request also won't exist when the connection close event runs
  var remoteAddress = req.connection.remoteAddress;
  var remotePort = req.connection.remotePort;
  var host = req.headers.host;
  var connection = req.connection;

  // output bytes read by socket on each request
  console.log('HTTP Request [' + remoteAddress + ':' + remotePort + '] [' + host + '] - connection Bytes Read: ' + connection.bytesRead);

  // setup handle for connection close event
  //
  // to avoid the handle being added multiple times we add the handle onto
  // the connection object which will persist between http requests
  //
  // we store the handler so we can check whether it has already been added
  // to the connection listeners array - a less robust alternative would be to
  // add a flag like connection.closeHandleAdded = true
  connection.handle = connection.handle || {};
  if (!connection.handle.onconnectionClose) {
    connection.handle.onconnectionClose = function() {
      onconnectionClose(remoteAddress, remotePort, host, connection.bytesRead);
    }
  }

  // check whether the close handle has already been added to the connection
  // if not add it
  if(connection.listeners('close').indexOf(connection.handle.onconnectionClose) == -1)
  {
    // attach handler to connection close event
    connection.on('close', connection.handle.onconnectionClose);
    // set connection idle timeout to 5 secs for testing purposes (default is 2min)
    connection._idleTimeout = 5000;
  }

  // process http request as required
  res.writeHead(200, {'Content-Type': 'text/plain'});
  res.end('ok');

}).listen(1337, '127.0.0.1');
console.log('Server running at http://127.0.1.1:1337/');

function onconnectionClose (remoteAddress, remotePort, host, bytesRead) {
   console.log('connection Closed [' + remoteAddress + ':' + remotePort + '] [' + host + '] - connection Bytes Read: ' + bytesRead);
}

答案 1 :(得分:0)

您应该查看Http Trace

它是一个node.js模块,用于捕获,解码和分析HTTP和WebSocket流量。 它可以找到每个请求的大小和域名,因此通过一些调整,您应该能够在此完成您想要完成的任务。

在我的Ubuntu服务器上使用节点v0.6.15运行良好,我所要做的就是“apt-get install libpcap0.8-dev”。

答案 2 :(得分:0)

尝试使用此模块来衡量HTTP响应/请求:https://github.com/hex7c0/transfer-rate

通过套接字在客户端和服务器之间发送数据。每个HTTP响应/请求都有自己的套接字。模块在套接字中获得发送字节(响应的 socket.bytesWritten ,请求的 socket.bytesRead )。发送数据的时间由命令( process.hrtime(start))计算。然后,我们将结果除以得到实际的传输速率。