User-agent: * Disallow: /check/ Disallow: /bundles/ Disallow: /assets/ Disallow: /system/ # Sitemap Sitemap: https://familienanwaelte-dav.de/share/familienanwaelte.xml Sitemap: https://anwalt.familienanwaelte-dav.de/share/anwalt_familienwaelte.xml Sitemap: https://anwalt.familienanwaelte-dav.de/share/sitemap-ff.xml # Decrease bing/msn crawl rate User-agent: bingbot Crawl-delay: 1 User-agent: msnbot Crawl-delay: 1 User-agent: msnbot-media Crawl-delay: 1 #Googlebot User-agent: Googlebot Allow: *.css Allow: *.js