• User

    Risorsa bloccata da robots

    Ciao ragazzi una domanidina semplice semplice:
    nel file robots ho una risorsa bloccata volutamente
    disallow: /site-map
    ovviamente non mi interessa che legga la pagina del sito dove c'è questa sitemap, mentre sitemap index viene caricata dal seo di yoast.
    E' un problema secondo voi ?

    Vi posto comunque la sitemap nel caso:

    "inizio file robots"

    User-agent: Yandex
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-login.php
    Disallow: /wp-register.php
    Disallow: /wp-content/themes
    Disallow: /wp-content/plugins
    Disallow: /wp-content/upgrade
    Disallow: /wp-content/themes_backup
    Disallow: /wp-content/cache
    Disallow: /xmlrpc.php
    Disallow: /template.html
    Disallow: /wp-comments
    Disallow: /cgi-bin
    Disallow: /trackback
    Disallow: /feed
    Disallow: /comments
    Disallow: /comment-page
    Disallow: /replytocom=
    Disallow: /author
    Disallow: /?author=
    Disallow: /tag
    Disallow: /?feed=
    Disallow: /?s=
    Disallow: /?se=

    User-agent: *
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-login.php
    Disallow: /wp-register.php
    Disallow: /wp-content/themes
    Disallow: /wp-content/plugins
    Disallow: /wp-content/upgrade
    Disallow: /wp-content/themes_backup
    Disallow: /wp-content/cache
    Disallow: /xmlrpc.php
    Disallow: /template.html
    Disallow: /wp-comments
    Disallow: /cgi-bin
    Disallow: /trackback
    Disallow: /feed
    Disallow: /comments
    Disallow: /comment-page
    Disallow: /replytocom=
    Disallow: /author
    Disallow: /?author=
    Disallow: /tag
    Disallow: /?feed=
    Disallow: /?s=
    Disallow: /?se=
    Disallow: /site-map
    Crawl-delay: 10

    Host: www nomesito.com
    Sitemap: www nomesito.com/sitemap.xml

    "fine file robots"