Slackware Current Repository by Conraid ====================================================================== reppy2 (Robots Exclusion Protocol Parser for Python) Replaces the built-in robotsparser with a RFC-conformant implementation that supports modern robots.txt constructs like Sitemaps, Allow, and Crawl-delay. HOME: http://github.com/seomoz/reppy ====================================================================== REQUIRES: python-dateutil cachetools