Slackware Current Repository by Conraid

======================================================================

python-protego (robots.txt parser)

Protego is a pure-Python robots.txt parser with support for modern
conventions.

HOME: https://github.com/scrapy/protego

======================================================================