Sie befinden sich hier: eisfair / Pack-Eis
News News News

Content

perl-www-robotrules (perl)

Perl - WWW::RobotRules (Offizielles Paket)

Version: 3.0.0 Status: stable Release Datum: 2020-06-22
Autor: the eisfair team, team(at)eisfair(dot)org
Internal Program Version: WWW::RobotRules  6.02.5.30.1

This module parses _/robots.txt_ files as specified in "A Standard for
Robot Exclusion", at http://www.robotstxt.org/wc/norobots.html
Webmasters
can use the _/robots.txt_ file to forbid conforming robots from accessing
parts of their web site.

http://search.cpan.org/dist/WWW-RobotRules
SHA256-Prüfsumme: 343e9b68c62fef3dacd2a13cb8152a1533fc607ae9f44edceb66be8261021a3f
Größe: 5.79 KByte
Info-Datei: https://www.pack-eis.de/dl.php?l=40253/perl-www-robotrules.tar.bz2.info
Benötigte Pakete: perl 3.0.0
perl-uri 3.0.0