Changeset 109887 in spip-zone


Ignore:
Timestamp:
Apr 12, 2018, 11:01:38 AM (3 years ago)
Author:
real3t@…
Message:

Synchronisation avec le plugin En travaux

File:
1 edited

Legend:

Unmodified
Added
Removed
  • _squelettes_/soyezcreateurs_net/trunk/plugins/soyezcreateurs/robots.txt.html

    r107504 r109887  
    66# @template: #SQUELETTE
    77
    8 User-agent: *
     8User-agent: *[
     9Disallow: /
     10(#REM|is_entravaux|ou{#CONFIG{entravaux_disallow_robots}})][
    911Allow:    /local/cache-css/
    1012Allow:    /local/cache-js/
    1113Disallow: /local/
    1214Disallow: /ecrire/
    13 Crawl-delay: 1
    1415Disallow: /sites/
    15 Allow:    /sites/[(#URL_SITE_SPIP|replace{'www\.',''}|replace{'ww2\.',''}|replace{'http://',''}|replace{'https://',''})]
     16Allow:    /sites/[(#URL_SITE_SPIP|replace{'www\.',''}|replace{'ww2\.',''}|replace{'\.g2w\.fr',''}|replace{'http://',''}|replace{'https://',''})]
    1617
    1718Sitemap: #URL_SITE_SPIP/sitemap.xml
     19
     20User-agent: bingbot
     21Crawl-delay: 1
     22
     23(#REM|is_entravaux|ou{#CONFIG{entravaux_disallow_robots}}|non)]
Note: See TracChangeset for help on using the changeset viewer.