GNU Wget - Bugs: bug #30999, wget should respect robots.txt...
bug #30999: wget should respect robots.txt directive crawl-delay
Follow 2 latest changes.
Date | Changed by | Updated Field | Previous Value | => | Replaced by |
---|---|---|---|---|---|
2012-07-04 | schubiger | Status | None | ![]() |
In Progress |
Assigned to | None | ![]() |
schubiger |
Powered by Savane 3.13-7f26.
Corresponding source code