站点地图生成器无法生成站点地图

时间:2017-06-26 22:17:01

标签: ruby-on-rails sitemap dreamhost google-sitemap

我有这个网站https://shopus.pk。我无法使用Sitemap生成工具生成站点地图。他们只是给出错误,例如"错误:422 Unprocessable Entity"或者只给我一个如下的URL: -

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">
</urlset>

据我所知,网站或服务器的安全设置可能存在一些问题。但请有人帮我确定问题所在。感谢

BTW我的网站由dreamhost托管。但我不认为dreamhost与此有任何关系。

我尝试了https://www.xml-sitemaps.com/http://www.web-site-map.com/http://www.check-domains.com/sitemap/index.phphttps://websiteseochecker.com/html-sitemap-generator/等等。

我也下载并尝试了A1 Sitemap Generator,gnucrawlandmap,SiteMapBuilder,HSEO Sitemap Generator以及一些免费的站点地图生成工具。

以上所有网站或工具都只会提供访问错误或只返回1或2个网址。

由于我的网站建立在Ruby on Rails上,我的生产环境配置文件如下: -

Rails.application.configure do
  # Settings specified here will take precedence over those in config/application.rb.

  # Code is not reloaded between requests.
  config.cache_classes = true

  # Eager load code on boot. This eager loads most of Rails and
  # your application in memory, allowing both threaded web servers
  # and those relying on copy on write to perform better.
  # Rake tasks automatically ignore this option for performance.
  config.eager_load = true

  # Full error reports are disabled and caching is turned on.
   config.consider_all_requests_local       = false
   config.action_controller.perform_caching = true

  # Enable Rack::Cache to put a simple HTTP cache in front of your application
  # Add `rack-cache` to your Gemfile before enabling this.
  # For large-scale production use, consider using a caching reverse proxy like
  # NGINX, varnish or squid.
  # config.action_dispatch.rack_cache = true

  # Disable serving static files from the `/public` folder by default since
  # Apache or NGINX already handles this.
  config.serve_static_files = ENV['RAILS_SERVE_STATIC_FILES'].present?

  # Compress JavaScripts and CSS.
  config.assets.js_compressor = :uglifier
  # config.assets.css_compressor = :sass

  # Do not fallback to assets pipeline if a precompiled asset is missed.
  config.assets.compile = true

  # Asset digests allow you to set far-future HTTP expiration dates on all assets,
  # yet still be able to expire them through the digest params.
  config.assets.digest = true

  # `config.assets.precompile` and `config.assets.version` have moved to config/initializers/assets.rb

  # Specifies the header that your server uses for sending files.
  # config.action_dispatch.x_sendfile_header = 'X-Sendfile' # for Apache
  # config.action_dispatch.x_sendfile_header = 'X-Accel-Redirect' # for NGINX

  # Force all access to the app over SSL, use Strict-Transport-Security, and use secure cookies.
  config.force_ssl = true

  # Use the lowest log level to ensure availability of diagnostic information
  # when problems arise.
  config.log_level = :error

  # Prepend all log lines with the following tags.
  # config.log_tags = [ :subdomain, :uuid ]

  # Use a different logger for distributed setups.
  # config.logger = ActiveSupport::TaggedLogging.new(SyslogLogger.new)

  # Use a different cache store in production.
  # config.cache_store = :mem_cache_store

  # Enable serving of images, stylesheets, and JavaScripts from an asset server.
  # config.action_controller.asset_host = 'http://assets.example.com'

  # Ignore bad email addresses and do not raise email delivery errors.
  # Set this to true and configure the email server for immediate delivery to raise delivery errors.
  # config.action_mailer.raise_delivery_errors = false

  config.action_mailer.default_url_options = { host: "https://shopus.pk" }
  # configure action_mailer
   config.action_mailer.delivery_method = :smtp
   config.action_mailer.smtp_settings = {}
  config.action_mailer.raise_delivery_errors = true
  config.action_mailer.perform_deliveries = true
  config.action_mailer.asset_host = 'https://shopus.pk'
  # Enable locale fallbacks for I18n (makes lookups for any locale fall back to
  # the I18n.default_locale when a translation cannot be found).
  config.i18n.fallbacks = true

   # Send deprecation notices to registered listeners.
   config.active_support.deprecation = :notify

  # Use default logging formatter so that PID and timestamp are not suppressed.
   config.log_formatter = ::Logger::Formatter.new

   # Do not dump schema after migrations.
  config.active_record.dump_schema_after_migration = false
end

这就是我的应用程序控制器的样子: -

class ApplicationController < ActionController::Base
  # Prevent CSRF attacks by raising an exception.
  # For APIs, you may want to use :null_session instead.
  protect_from_forgery with: :exception
  include SessionsHelper
  include ApplicationHelper
  private
  # Confirms a logged-in user.
  def logged_in_customer
    unless logged_in?
      store_location
      redirect_to login_url
    end
  end
end

如果您需要其他任何方法来解决此问题,请与我们联系。

1 个答案:

答案 0 :(得分:0)

好的,好像我已经找到了问题所在。但仍然不确定。

因此,在尝试几乎每个站点地图生成器失败后,我决定使用Ruby Gems Nokogiri和Mechanize创建自己的站点地图生成器。但令我惊讶的是,每当我尝试从我的网站中提取HTML代码时,相同的错误都会显示“422 Unprocessable Entity”。这是我从一些站点地图生成器获得的确切错误消息。

我从Applications控制器中删除了“ protect_from_forgery with::exception ”,并且站点地图生成器开始在我的网站上运行。

但这不对,因为“ protect_from_forgery with :: exception ”应该在那里。我还有2个其他网站,其中“ protect_from_forgery with :: exception ”包含在应用程序控制器中。 Sitemap生成器在使用这两个网站时不会出现任何问题。

我的第一个网站和另外两个网站之间的唯一区别是我的第一个网站使用的是ajax而另外两个网站很简单。所以当我从

中删除 format.js 行时,我终于明白了
respond_to do |format|
   format.js
   format.html
end
从主控制器中的索引操作中获取代码块,事情就会开始起作用。后来我意识到我应该用format.html下面的format.js编写respond_to代码,就像这个

一样
respond_to do |format|
   format.html
   format.js
end

在此之后,我在format.html以上格式的所有控制器的每个操作中更改了所有的respond_to代码.js

现在一切正常。

然而,我仍然感到困惑,不确定我的问题原因是否正确?我还是一名新手程序员。另外,我不明白为什么format.html和format.js的顺序在这种情况下很重要。

我对所有建议持开放态度,并对问题有所了解。