Sie befinden sich hier: eisfair / Pack-Eis
News News News


perl-www-robotrules (perl)

Perl - WWW::RobotRules (Offizielles Paket)

Version: 3.0.0 Status: stable Release Datum: 2020-06-22
Autor: the eisfair team, team(at)eisfair(dot)org
Internal Program Version: WWW::RobotRules

This module parses _/robots.txt_ files as specified in "A Standard for
Robot Exclusion", at
can use the _/robots.txt_ file to forbid conforming robots from accessing
parts of their web site.
SHA256-Prüfsumme: 343e9b68c62fef3dacd2a13cb8152a1533fc607ae9f44edceb66be8261021a3f
Größe: 5.79 KByte
Benötigte Pakete: perl 3.0.0
perl-uri 3.0.0