清漆,是什么造成了打击?

时间:2016-02-17 06:46:51

标签: varnish varnish-4

这是varnishlog(已编辑 - 已展开以提供更多信息):

*   << Request  >> 172651    
-   Begin          req 172650 rxreq
-   Timestamp      Start: 1455791132.581465 0.000000 0.000000
-   Timestamp      Req: 1455791132.581465 0.000000 0.000000
-   ReqStart       127.0.0.1 47991
-   ReqMethod      GET
-   ReqURL         /
-   ReqProtocol    HTTP/1.1
-   ReqHeader      X-Real-IP: x.x.x.x
-   ReqHeader      X-Forwarded-For: x.x.x.1, x.x.x.2
-   ReqHeader      X-Forwarded-Proto: https
-   ReqHeader      X-Forwarded-Port: 443
-   ReqHeader      Host: mydomain.com
-   ReqHeader      User-Agent: Go-http-client/1.1  (//benchmark app, but regular browser client happens the same
-   ReqHeader      Cf-Connecting-Ip: x.x.x.x
-   ReqHeader      Cf-Ipcountry: AND
-   ReqHeader      Cf-Origin-Https: off
-   ReqHeader      Cf-Ray: 27690752ab232e21-NRT
-   ReqHeader      Cf-Visitor: {"scheme":"https"}
-   ReqUnset       X-Forwarded-For: x.x.x.1, x.x.x.2
-   ReqHeader      X-Forwarded-For: x.x.x.ext, x.x.x.1, x.x.x.2
-   VCL_call       RECV
-   VCL_return     hash
-   VCL_call       HASH
-   VCL_return     lookup
-   Debug          "XXXX HIT-FOR-PASS"
-   HitPass        393349
-   VCL_call       PASS
-   VCL_return     fetch
-   Link           bereq 172652 pass
-   Timestamp      Fetch: 1455791132.581733 0.000268 0.000268
-   RespProtocol   HTTP/1.1
-   RespStatus     200
-   RespReason     OK
-   RespHeader     Server: nginx
-   RespHeader     Date: Thu, 18 Feb 2016 10:25:32 GMT
-   RespHeader     Content-Type: text/html; charset=utf-8
-   RespHeader     Vary: Accept-Encoding, Accept-Encoding
-   RespHeader     Etag: "1455788472-0"
-   RespHeader     Content-Language: ja
-   RespHeader     Cache-Control: no-cache
-   RespHeader     Last-Modified: Thu, 18 Feb 2016 09:41:12 GMT
-   RespHeader     X-Content-Options: nosniff
-   RespHeader     X-Micro-Cache: HIT
-   RespHeader     X-Varnish: 172651
-   RespHeader     Age: 0
-   RespHeader     Via: 1.1 varnish-v4
-   VCL_call       DELIVER
-   VCL_return     deliver
-   Timestamp      Process: 1455791132.581744 0.000279 0.000011
-   RespHeader     Accept-Ranges: bytes
-   RespHeader     Transfer-Encoding: chunked
-   Debug          "RES_MODE 8"
-   RespHeader     Connection: keep-alive
-   Timestamp      Resp: 1455791132.581794 0.000329 0.000049
-   ReqAcct        336 0 336 436 57069 57505
-   End            

我已经读过,这是在设置了set-cookie标头或cache-control时创建的:max-age = 0已设置。

好吧,我在我的子vcl_backend_response中试图避免命中传递。这很粗鲁,但我不知道后端是什么造成了这个打击通过:

sub vcl_backend_response {
  unset beresp.http.set-cookie;
  unset beresp.http.expires;
  set beresp.http.Cache-Control = "max-age=6000";
}

我摆脱了Expire,因为它设置为时间戳0.所以我可能会这样。然后我尝试使用Cache-control,但同样如此。我即将以这个速度取消所有标题......

毕竟是304响应,为什么不缓存呢?

更多信息:后端是Drupal应用程序。

编辑1:关于vcl_recv

是的我确实有东西,我正在返回一些路径的传递(不是我正在检查的路径),我正在取消文件的cookie,而我正在取消所有其他不是drupal会话的cookie。它是mroe或更少的复制/粘贴drupal默认sub vcl_recv。如果你愿意,我可以在这里复制。

顺便说一下,我改变了其他东西,现在我也在响应200中被击中(但是当我使用基准测试工具时)。有人删除了答案,说可能是因为回复304.我正在检查,但答案消失了:(

好的就是vcl_recv:

sub vcl_recv {
 if (req.url ~ "^/status\.php$" ||
    req.url ~ "^/admin/.*$" ||
     [...]
     req.url ~ "^.*\.js.*$" ) 
    {
       return (pass);
    }

  if (req.url ~ "^/admin/content/backup_migrate/export") {
    return (pipe);
  }

  ## COOKIES ##
  if (req.url ~ "(?i)\.(css|js|jpg|jpeg|gif|png|ico|svg|map)(\?.*)?$") {
    unset req.http.Cookie;
  }
  if (req.http.Cookie) {
    set req.http.Cookie = ";" + req.http.Cookie;
    set req.http.Cookie = regsuball(req.http.Cookie, "; +", ";"); 
    set req.http.Cookie = regsuball(req.http.Cookie, ";(SESS[a-z0-9]+|SSESS[a-z0-9]+|NO_CACHE)=", "; \1=");
    set req.http.Cookie = regsuball(req.http.Cookie, ";[^ ][^;]*", "");
    set req.http.Cookie = regsuball(req.http.Cookie, "^[; ]+|[; ]+$", "");
   if (req.http.Cookie == "") {
        unset req.http.Cookie;
    }
    # if any of our cookies of interest are still there, we disable caching and pass the request
    else {
        return (pass);
    }
 }
}

它几乎总是在所有的http中被击中。 304个回复和200个回复。我已经编辑了上面的varnishlog,以显示一个完整的示例来提供更多信息。

编辑: 所以这是请求的日志,然后显示为pass for pass。肯定是设置命中传球的罪名:

-   ReqHeader      X-Forwarded-For: 127.0.0.1
-   VCL_return     hash
-   VCL_call       HASH
-   VCL_return     lookup
-   VCL_call       MISS
-   VCL_return     fetch
-   Link           bereq 3 fetch
-   Timestamp      Fetch: 1456731597.992472 0.099948 0.099948
-   RespProtocol   HTTP/1.1
-   RespStatus     200
-   RespReason     OK
-   RespHeader     Date: Mon, 29 Feb 2016 07:39:57 GMT
-   RespHeader     Content-Type: text/html; charset=utf-8
-   RespHeader     Content-Encoding: gzip
-   RespHeader     Vary: Accept-Encoding
-   RespHeader     Etag: "1456730796-0"
-   RespHeader     Content-Language: ja
-   RespHeader     Cache-Control: no-cache
-   RespHeader     Last-Modified: Mon, 29 Feb 2016 07:26:36 GMT
-   RespHeader     Expires: Thu, 01 Jan 1970 00:00:01 GMT
-   RespHeader     X-Content-Options: nosniff
-   RespHeader     X-Micro-Cache: EXPIRED
-   RespHeader     X-Varnish: 2
-   RespHeader     Age: 0
-   RespHeader     Via: 1.1 varnish-v4
-   RespUnset      Etag: "1456730796-0"
-   RespHeader     ETag: W/"1456730796-0"
-   VCL_call       DELIVER
-   RespHeader     X-Cache: MISS
-   RespHeader     X-Cache-Hits: 0
-   RespUnset      X-Varnish: 2
-   RespUnset      Via: 1.1 varnish-v4
-   VCL_return     deliver
-   Timestamp      Process: 1456731597.992517 0.099993 0.000044
-   RespUnset      Content-Encoding: gzip
-   RespHeader     Accept-Ranges: bytes
-   RespHeader     Content-Length: 53980
-   Debug          "RES_MODE 42"
-   RespHeader     Connection: keep-alive
-   Gzip           U D - 12752 53980 80 101936 101946
-   Timestamp      Resp: 1456731597.992817 0.100293 0.000300
-   ReqAcct        746 0 746 437 53980 54417

2 个答案:

答案 0 :(得分:2)

这个问题太长了,我担心它对其他人也没用。

感谢另一个答案给出的链接,我看到了这个(vcl_backend_response的默认实现):

sub vcl_backend_response {
if (beresp.ttl <= 0s ||
    beresp.http.Set-Cookie ||
    beresp.http.Surrogate-control ~ "no-store" ||
    (!beresp.http.Surrogate-Control &&
    beresp.http.Cache-Control ~ "no-cache|no-store|private") ||
    beresp.http.Vary == "*") {
    /*
     * Mark as "Hit-For-Pass" for the next 2 minutes
     */
    set beresp.ttl = 120s;
    set beresp.uncacheable = true;
}
return (deliver);
}

这是导致通过命中的所有条件。多亏了我可以看到导致传递命中的原因正是这个beresp.ttl&lt; = 0。

那么beres.ttl的值是多少?在同一个链接上我们读到了这个:beresp.ttl初始化它找到的第一个值:

The s-maxage variable in the Cache-Control response header field
The max-age variable in the Cache-Control response header field
The Expires response header field
The default_ttl parameter.

修改vcl_backend_response中的标题并不重要,因为ttl已经设置好了!

好吧,看着我的标题,我可以从后端看到:

 -  RespHeader Expires: Thu, 01 Jan 1970 00:00:01 GMT

这是导致击球的原因。这就是我的问题的答案。现在,为什么我有这个标题我不知道,这将是一个不同的问题。 (我修改了nginx,过期30d;到了没有结果的所有位置)

答案 1 :(得分:1)

可能是你的问题恰好是304响应:

Varnish 3书中说:

  

默认情况下,只会缓存以下状态代码:

200: OK
203: Non-Authoritative Information
300: Multiple Choices
301: Moved Permanently
302: Moved Temporarily
307: Temporary Redirect
410: Gone
404: Not Found
     

您仍然可以缓存其他状态代码,但您必须设置   beresp.ttl自己在vcl_fetch中为正值。

     

http://book.varnish-software.com/3.0/VCL_Basics.html

让我感到惊讶的是,Varnish 4书中还提到“304:Not modified”是可缓存的。 http://book.varnish-software.com/4.0/chapters/VCL_Basics.html

这对我来说没有意义,因为如果Varnish缓存条件请求的304响应,那么对于同一资源的每个非条件请求也应该得到304响应,而没有响应主体,这似乎是无用的。