User-agent: * Disallow: /out/ Disallow: /xhr/ Disallow: /r/ Disallow: /search User-agent: panscient.com Disallow: / User-agent: ia_archiver Disallow: / User-agent: xenu's Disallow: / User-agent: MJ12bot Disallow: / User-agent: dotbot Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: sistrix Disallow: / User-agent: voltron Disallow: / User-agent: SearchmetricsBot Disallow: / User-agent: proximic Disallow: / User-agent: wotbox Disallow: / User-agent: ltx71 - (http://ltx71.com/) Disallow: / User-agent: grapeshot Disallow: / User-agent: rogerbot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: AlphaSeoBot Disallow: / User-agent: CCBot Disallow: / User-agent: turnitinbot Disallow: / User-Agent: panscient.com Disallow: / User-agent: zoominfo Disallow: / User-agent: oBot Disallow: / User-agent: SpiderLing Disallow: / User-agent: BUbiNG Disallow: / User-agent: LCC Disallow: / User-agent: BLEXBot Disallow: / User-agent: Exabot Disallow: / User-agent: FacebookBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: trendictionbot Disallow: / User-agent: SEBot-WA Disallow: / User-agent: SeekportBot Disallow: / User-agent: BrightEdge Disallow: / User-agent: IbouBot Disallow: / User-agent: ShapBot Disallow: / User-agent: dataprovider Disallow: / User-agent: LinkupBot Disallow: / User-agent: PetalBot Disallow: / User-agent: serpstatbot Disallow: / User-agent: SERankingBacklinksBot Disallow: / User-agent: AwarioBot Disallow: / User-agent: AwarioRssBot Disallow: / User-agent: AwarioSmartBot Disallow: / User-agent: Diffbot Disallow: / User-agent: SemrushBot-SI Disallow: / User-agent: SemrushBot-BA Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: SemrushBot-OCOB Disallow: / User-agent: SemrushBot-EO Disallow: / User-agent: keys-so-bot Disallow: / User-agent: SEOkicks Disallow: / User-agent: SeobilityBot Disallow: / User-agent: RyteBot Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: AhrefsSiteAudit Disallow: /