如何使用node.js作为Web服务器来监控每个域的带宽使用情况?
有没有人知道我没有遇到的API调用?
或其他人在多租户环境中使用的模块或其他方法,您需要按带宽收费?
更新
有没有人知道可以放在任何网络服务器(node.js,apache等)之前的轻量级代理/服务器,它可以通过检查域来记录这些带宽统计数据?
答案 0 :(得分:4)
如果不修改node.js核心,最好的选择似乎是使用bytesRead和bytesWritten变量在套接字级别跟踪它。
这实际上比仅测量http请求/响应字符串的大小更准确,因为其他一些带宽跟踪器会计算传输的数据。
您有2个选项:1)记录每个请求的字节数或2)记录TCP连接上的字节数。
登录请求级别将提供可能有用的实时数据。但是,根据您实施日志记录的方式,它可能会减慢速度。最好将它保存在内存中,并经常将其转储到磁盘/数据库。
登录请求级别:
var http = require('http');
var server = http.createServer(function (req, res) {
// setup a counter for bytes already logged
req.connection.bytesLogged = (req.connection.bytesLogged || 0);
// output the bytes read by the socket
console.log('Socket [' + req.connection.remoteAddress + '] [' + req.headers.host + '] - Bytes Read: ' + req.connection.bytesRead);
// calculate the bytes of the request (includes headers and other tcp overhead - more realistic)
req.bytes = req.connection.bytesRead - req.connection.bytesLogged;
// output the bytes size of the request (note this is calculated after the TCP packets have been collected from the network and parsed by the HTTP parser
console.log('Request [' + req.connection.remoteAddress + '] [' + req.headers.host + '] - Bytes: ' + req.bytes);
// log the bytes to a memory array, DB or disk (implementation not shown)
// [code here]
// add the request bytes to the counter
req.connection.bytesLogged = req.connection.bytesLogged + req.bytes;
// normal http server processing like return document or file
res.writeHead(200, {'Content-Type': 'text/plain'});
res.end('ok');
}).listen(1337, '127.0.0.1');
console.log('Server running at http://127.0.1.1:1337/');
记录套接字级别:
var http = require('http');
var server = http.createServer(function (req, res) {
// create some variables for data we want to log
//
// due to the way node.js works the remoteAddress and remotePort will not
// be available in the connection close event
// we also need to store the domain/host from the http header because the http
// request also won't exist when the connection close event runs
var remoteAddress = req.connection.remoteAddress;
var remotePort = req.connection.remotePort;
var host = req.headers.host;
var connection = req.connection;
// output bytes read by socket on each request
console.log('HTTP Request [' + remoteAddress + ':' + remotePort + '] [' + host + '] - connection Bytes Read: ' + connection.bytesRead);
// setup handle for connection close event
//
// to avoid the handle being added multiple times we add the handle onto
// the connection object which will persist between http requests
//
// we store the handler so we can check whether it has already been added
// to the connection listeners array - a less robust alternative would be to
// add a flag like connection.closeHandleAdded = true
connection.handle = connection.handle || {};
if (!connection.handle.onconnectionClose) {
connection.handle.onconnectionClose = function() {
onconnectionClose(remoteAddress, remotePort, host, connection.bytesRead);
}
}
// check whether the close handle has already been added to the connection
// if not add it
if(connection.listeners('close').indexOf(connection.handle.onconnectionClose) == -1)
{
// attach handler to connection close event
connection.on('close', connection.handle.onconnectionClose);
// set connection idle timeout to 5 secs for testing purposes (default is 2min)
connection._idleTimeout = 5000;
}
// process http request as required
res.writeHead(200, {'Content-Type': 'text/plain'});
res.end('ok');
}).listen(1337, '127.0.0.1');
console.log('Server running at http://127.0.1.1:1337/');
function onconnectionClose (remoteAddress, remotePort, host, bytesRead) {
console.log('connection Closed [' + remoteAddress + ':' + remotePort + '] [' + host + '] - connection Bytes Read: ' + bytesRead);
}
答案 1 :(得分:0)
您应该查看Http Trace。
它是一个node.js模块,用于捕获,解码和分析HTTP和WebSocket流量。 它可以找到每个请求的大小和域名,因此通过一些调整,您应该能够在此完成您想要完成的任务。
在我的Ubuntu服务器上使用节点v0.6.15运行良好,我所要做的就是“apt-get install libpcap0.8-dev”。
答案 2 :(得分:0)
尝试使用此模块来衡量HTTP响应/请求:https://github.com/hex7c0/transfer-rate
通过套接字在客户端和服务器之间发送数据。每个HTTP响应/请求都有自己的套接字。模块在套接字中获得发送字节(响应的 socket.bytesWritten ,请求的 socket.bytesRead )。发送数据的时间由命令( process.hrtime(start))计算。然后,我们将结果除以得到实际的传输速率。