#badbots User-agent: 008 User-agent: crawler4j User-agent: crawler4j (http://code.google.com/p/crawler4j/) User-agent: Curious George - www.analyticsseo.com/crawler User-agent: Curious George - www.analyticsseo.com User-agent: MegaIndex.ru/2.0 User-agent: MegaIndex.ru/ User-agent: +https://www.megaindex.ru/ User-agent: Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +https://www.megaindex.ru/?tab=linkAnalyze) User-agent: Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+) User-agent: MJ12 User-agent: Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) User-agent: Steeler User-agent: Microsoft-WebDAV-MiniRedir/6.1.7601 User-agent: Mozilla/5.0 (compatible; Findxbot/1.0; +http://www.findxbot.com) User-agent: Findxbot User-agent: Mozilla/5.0 (compatible; SeznamBot/3.2; +http://fulltext.sblog.cz/) User-agent: SeznamBot User-agent: Seznam User-agent: Mozilla/4.0 (compatible; Vagabondo/4.0; http://webagent.wise-guys.nl/) User-agent: Mozilla/4.0 (compatible; Vagabondo/4.0; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/) User-agent: Vagabondo User-agent: Jakarta Commons-HttpClient/3.0.1 User-agent: LWP::Simple/5.822 User-agent: Mozilla/5.0 (compatible; SMTBot/1.0; +http://www.similartech.com/smtbot) User-agent: SMTBot User-agent: Mozilla/5.0 (compatible; memoryBot/1.22.56 +http://internetmemory.org/en/) User-agent: memoryBot User-agent: Mozilla/5.0 (compatible; smrjbot/0.0.20) User-agent: smrjbot User-agent: Mozilla/5.0 (compatible; spbot/4.4.2; +http://OpenLinkProfiler.org/bot ) User-agent: spbot User-agent: MJ12bot User-agent: BaiDuSpider User-agent: Exabot User-agent: Yandex User-agent: BSpider User-Agent: panscient.com User-agent: BUbiNG User-agent: IS Alpha/Nutch-1.1 User-agent: TinEye User-agent: ltx71 - (http://ltx71.com/) User-agent: AhrefsBot User-agent: dotbot User-agent: proximic User-agent: grapeshot User-agent: GrapeshotCrawler User-agent: DataForSeoBot User-agent: BLEXBot Disallow:/ User-agent: Bingbot User-agent: MSNBot User-agent: MSNBot-Media User-agent: BingPreview User-agent: AdIdxBot Disallow: /followers/* Disallow: /notes/* Disallow: /activity/* Disallow: /plants/* Disallow: /photos/* Disallow: /data/* Disallow: /search Disallow: /assets/* Disallow: /dashboard Disallow: /plants?tag= Crawl-delay: 10 User-agent: * Disallow: /ajax/* Disallow: /admin/ Disallow: /bibliotheek Disallow: /gardenplan Disallow: /out?url= Disallow: /login?callback= Disallow: /join?callback= Disallow: /dev/ Disallow: /plants/plantifier/* Disallow: /delete/ Disallow: /likes/ Disallow: /api/ Disallow: /fotoboek/ Disallow: /unlike/ Disallow: /tweets/ Disallow: /comment/ Disallow: /map/ Disallow: /login/ Disallow: /exchange/ Disallow: /garden/ Disallow: /zadenactie/ Disallow: /seed-libraries/ Disallow: /wishlist/ Disallow: /seeds Disallow: /users/ Disallow: /profile/ Disallow: /shop/source/ Disallow: /followers/* Disallow: /following/* Disallow: /map/getplantusers/* Sitemap: https://www.mygarden.org/sitemap