# https://fa-butor.hu/ Sitemap: https://fa-butor.hu/sitemap.xml User-agent: * Allow: / Crawl-Delay: 5 User-agent: MJ12bot Crawl-Delay: 60 User-agent: SERankingBacklinksBot Crawl-delay: 60 User-agent: DotBot Crawl-delay: 60 User-agent: AhrefsBot Crawl-Delay: 60 User-agent: Yandex Crawl-Delay: 60 User-agent: SeznamBot Request-rate: 1/1m