User-agent: Google-Extended User-agent: cohere-training-data-crawler User-agent: GPTBot User-agent: DotBot User-agent: DataForSeoBot User-agent: URL_Spider_Pro User-agent: xovi User-agent: um-IC User-agent: searchpreview User-agent: rogerbot User-agent: Openbot User-agent: backlink-check.de User-agent: BacklinkCrawler User-agent: ExtractorPro User-agent: Fasterfox User-agent: AhrefsBot User-agent: MJ12bot User-agent: SemrushBot User-agent: img2dataset User-agent: Amazonbot User-agent: Amzn-SearchBot User-agent: anthropic-ai User-agent: Applebot-Extended User-agent: Bytespider User-agent: CCBot User-agent: Claude-Web User-agent: ClaudeBot User-agent: Diffbot User-agent: cohere-ai User-agent: FacebookBot User-agent: FriendlyCrawler User-agent: ImagesiftBot User-agent: ICC-Crawler User-agent: meta-externalagent User-agent: VelenPublicWebCrawler User-agent: Timpibot User-agent: Scrapy User-agent: PetalBot User-agent: Omgilibot User-agent: Omgili User-agent: AI2Bot User-agent: Ai2Bot-Dolma User-agent: ISSCyberRiskCrawler User-agent: Kangaroo Bot User-agent: PanguBot User-agent: Sidetrade indexer bot User-agent: Webzio-Extended Disallow: / User-agent: archive.org_bot Disallow: /medien/downloads/linfo/ Disallow: /linfo