Skip to content

CentOS 7 - Updates for x86_64: development/libraries: perl-WWW-RobotRules

perl-WWW-RobotRules - Database of robots.txt-derived permissions

License: GPL+ or Artistic
Vendor: CentOS
This module parses /robots.txt files as specified in "A Standard for Robot
Exclusion", at <>. Webmasters can
use the /robots.txt file to forbid conforming robots from accessing parts
of their web site.


perl-WWW-RobotRules-6.02-5.el7.noarch [17 KiB] Changelog by Daniel Mach (2013-12-27):
- Mass rebuild 2013-12-27

Listing created by repoview