在heroku上使用redis-rails时Redis :: TimeoutError

时间:2013-06-03 21:20:14

标签: ruby-on-rails heroku redis resque redistogo

更新以包含Redis / Resque版本和堆栈跟踪(下方):

redis (3.0.4)
redis-namespace (1.3.0)
  redis (~> 3.0.0)
redis-store (1.1.2)
  redis (>= 2.2.0)
resque (1.24.1)
  mono_logger (~> 1.0)
  multi_json (~> 1.0)
  redis-namespace (~> 1.2)
  sinatra (>= 0.9.2)
  vegas (~> 0.1.2)
resque-scheduler (2.0.1)
  redis (>= 2.0.1)
  resque (>= 1.20.0)
  rufus-scheduler

我在heroku上看到间歇Redis::TimeoutError: Connection timed out,同时使用Rails.cache.fetch命令将一个中等大小的数组(~200个Fixnums)写入Redis商店。

我也在使用Resque。

我看到here Redis :: Client可以接收超时选项,但我看不到将初始化选项传递给Redis的位置。

我正在使用标准的heroku resque.rb

rails_root        = ENV['RAILS_ROOT'] || File.dirname(__FILE__) + '/../..'
rails_env         = ENV['RAILS_ENV'] || 'development'

resque_config     = YAML.load_file(rails_root + '/config/resque.yml')
ENV['REDIS_URI']  = resque_config[rails_env]
Resque.redis      = resque_config[rails_env]
Resque.inline     = rails_env == 'test'

require 'resque_scheduler'
require 'resque/scheduler'
require 'resque_scheduler/server'

Resque.schedule   = YAML.load_file(rails_root + '/config/resque-schedule.yml')

Resque.before_fork do
  defined?(ActiveRecord::Base) and
    ActiveRecord::Base.connection.disconnect!
end

Resque.after_fork do
  defined?(ActiveRecord::Base) and
    ActiveRecord::Base.establish_connection
end

我假设在这里实例化了Redis客户端。这是与production.rb中实例化的客户不同的客户端吗?

rails_root          = ENV['RAILS_ROOT'] || File.dirname(__FILE__) + '/../..'
rails_env           = ENV['RAILS_ENV'] || 'development'
resque_config = YAML.load_file(rails_root + '/config/resque.yml')
config.cache_store = :redis_store, resque_config[rails_env], { expires_in: 14.days }

据我所知,选项哈希是Rails.cache个选项。是否在此处实例化了新客户端?我如何将选项传递给这个?


更新为在heroku控制台中包含此实验,暗示它们是不同的客户端实例:

irb(main):002:0> Rails.cache
=> #<ActiveSupport::Cache::RedisStore:0x00000003860e18 @data=#<Redis client v3.0.4 for redis://spinyfin.redistogo.com:9485/0>, @options={:expires_in=>14 days}>
irb(main):003:0> Resque.redis.redis
=> #<Redis client v3.0.4 for redis://spinyfin.redistogo.com:9485/0>
irb(main):004:0> Rails.cache.instance_variable_get(:@data).object_id == Resque.redis.redis.object_id
=> false

堆栈追踪:

Redis::TimeoutError: Connection timed out
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis/client.rb:208:in `rescue in io'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis/client.rb:206:in `io'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis/client.rb:214:in `read'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis/client.rb:84:in `block in call'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis/client.rb:187:in `block (2 levels) in process'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis/client.rb:295:in `ensure_connected'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis/client.rb:177:in `block in process'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis/client.rb:256:in `logging'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis/client.rb:176:in `process'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis/client.rb:84:in `call'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis.rb:644:in `block in setex'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis.rb:36:in `block in synchronize'
    from /app/vendor/ruby-1.9.3/lib/ruby/1.9.1/monitor.rb:211:in `mon_synchronize'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis.rb:36:in `synchronize'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-3.0.4/lib/redis.rb:643:in `setex'
    from /app/vendor/bundle/ruby/1.9.1/gems/redis-store-1.1.2/lib/redis/store/interface.rb:17:in `setex'
... 11 levels...
    from /app/vendor/bundle/ruby/1.9.1/gems/activesupport-3.2.13/lib/active_support/cache.rb:299:in `fetch'
    ...SNIP...
    ...my code...
    ...SNIP...
    from /app/vendor/bundle/ruby/1.9.1/gems/activerecord-3.2.13/lib/active_record/relation/delegation.rb:6:in `each'
    from /app/vendor/bundle/ruby/1.9.1/gems/activerecord-3.2.13/lib/active_record/relation/delegation.rb:6:in `each'
    ...SNIP...
    ...my code...
    ...SNIP...
    from (irb):5
    from /app/vendor/bundle/ruby/1.9.1/gems/railties-3.2.13/lib/rails/commands/console.rb:47:in `start'
    from /app/vendor/bundle/ruby/1.9.1/gems/railties-3.2.13/lib/rails/commands/console.rb:8:in `start'
    from /app/vendor/bundle/ruby/1.9.1/gems/railties-3.2.13/lib/rails/commands.rb:41:in `<top (required)>'
    from script/rails:6:in `require'
    from script/rails:6:in `<main>'irb(main):006:0>  !    Heroku client internal error.
 !    Search for help at: https://help.heroku.com
 !    Or report a bug at: https://github.com/heroku/heroku/issues/new

    Error:       Operation timed out (Errno::ETIMEDOUT)
    Backtrace:   /usr/local/heroku/ruby/lib/ruby/1.9.1/openssl/buffering.rb:121:in `sysread'
                 /usr/local/heroku/ruby/lib/ruby/1.9.1/openssl/buffering.rb:121:in `readpartial'
                 /Users/me/.heroku/client/lib/heroku/client/rendezvous.rb:69:in `block in start'
                 /Users/me/.heroku/client/lib/heroku/client/rendezvous.rb:53:in `loop'
                 /Users/me/.heroku/client/lib/heroku/client/rendezvous.rb:53:in `start'
                 /Users/me/.heroku/client/lib/heroku/command/run.rb:132:in `rendezvous_session'
                 /Users/me/.heroku/client/lib/heroku/command/run.rb:119:in `run_attached'
                 /Users/me/.heroku/client/lib/heroku/command/run.rb:24:in `index'
                 /Users/me/.heroku/client/lib/heroku/command.rb:206:in `run'
                 /Users/me/.heroku/client/lib/heroku/cli.rb:28:in `start'
                 /usr/local/heroku/bin/heroku:24:in `<main>'

    Command:     heroku run rails c
    Plugins:     heroku-redis-cli
    Version:     heroku-toolbelt/2.39.4 (x86_64-darwin10.8.0) ruby/1.9.3

3 个答案:

答案 0 :(得分:1)

“连接超时”消息表示redis-rb无法启动与Redis服务器的连接。通常,您只想在应用启动时初始化一次Redis连接。但是,因为Resque forks(而不是使用像Sidekiq这样的线程),它必须为每个单独的作业初始化一个新的Redis连接。

通常,这不是问题,但Heroku在创建新的Redis连接时会出现间歇性问题。我在语言/客户端库/ Redis主机上看到过这个问题,除了减少你创建的Redis连接的数量之外,缓解问题的唯一方法是在Resque.after_fork块中自动重试连接Redis几次。 (例如,捕获超时错误,如果您尝试了3次,则重试或重新引发异常)

答案 1 :(得分:1)

这不是一个很好的答案,但在同事的推荐下,我从RedisToGo切换到openredis,这些问题立即消失了。

答案 2 :(得分:0)

由于this bug,您无法将网址和选项哈希传递给config.cache_store

config.cache_store = :redis_store, resque_config[rails_env], { expires_in: 14.days }

如果你传递一个URL和一个options hash,它会忽略URL并默认为localhost,这可能就是你看到超时的原因(我只是遇到了同样的问题)。

相反,做这样的事情:

redis_uri = URI.parse(ENV["REDISTOGO_URL"])
config.cache_store = :redis_store, {
  host: redis_uri.host,
  port: redis_uri.port,
  password: redis_uri.password,
  namespace: "cache",
  expires_in: 7.days
}