User-agent: * Disallow: */flyer$ Disallow: */kurskatalog-anfrage* Disallow: */kontakt$ Disallow: /reviewwidget.js* Disallow: /searches/widget* Disallow: /autocomplete/* Disallow: */informationsanfrage* Disallow: */zusaetzliche-informationsanfrage* Disallow: */download* Disallow: */registerClick* Disallow: */alternativen Disallow: */kurs-bewerten* Disallow: */bewertung-danke* Disallow: */bewertungen/* Disallow: /users/* Disallow: /mein-springest Disallow: /members Disallow: */buchungen Disallow: */buchung-bestaetigen/* Disallow: */buchung-bestaetigen-danke Disallow: */buchungen-danke Disallow: */payment/* Disallow: */payment-thanks/* Disallow: */payment-failed/* Disallow: */payment-retry/* Disallow: /mollie-callback/* # https://yandex.com/support/webmaster/controlling-robot/robots-txt.xml User-agent: Yandex Crawl-delay: 30 # http://www.baidu.com/search/spider.html User-agent: Baiduspider Crawl-delay: 30 # https://help.yahoo.com/kb/guide-meta-tags-robotstxt-slurp-sln2213.html User-agent: Slurp Crawl-delay: 30 # http://www.semrush.com/bot.html) User-agent: SemrushBot Disallow: / # http://mj12bot.com/ User-agent: MJ12bot Disallow: / User-agent: Linguee Bot Disallow: / # http://ltx71.com/ User-agent: ltx71 Disallow: / # http://webmeup-crawler.com/ User-agent: BLEXBot Disallow: / # https://www.seokicks.de/robot.html User-agent: SEOkicks-Robot Disallow: / # http://www.exabot.com/go/robot User-agent: Exabot Disallow: / User-agent: seoscanners.net Disallow: / # http://www.sogou.com/docs/help/webmasters.htm User-agent: Sogou Disallow: /