Package perl-WWW-RobotRules: Information
Source package: perl-WWW-RobotRules
Version: 6.02-alt1
Build time: Feb 20, 2012, 08:43 PM
Category: Development/Perl
Report package bugHome page: http://search.cpan.org/dist/WWW-RobotRules/
License: GPL or Artistic
Summary: Database of robots.txt-derived permissions
Description:
This module parses /robots.txt files as specified in "A Standard for Robot Exclusion", at <http://www.robotstxt.org/wc/norobots.html> Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site.
Maintainer: Alexey Tourbin
Last changed
Feb. 20, 2012 Alexey Tourbin 6.02-alt1
- 6.01 -> 6.02
Nov. 15, 2011 Alexey Tourbin 6.01-alt2
- rebuilt as plain src.rpm
March 21, 2011 Alexey Tourbin 6.01-alt1
- initial revision