Why doesn't "wget -r" work for /scratch/ directory of koji.fedoraproject.org?

Orion Poplawski orion at cora.nwra.com
Tue Mar 11 19:58:25 UTC 2008


Michael Schwendt wrote:
> 
> Examine the contents of the robots.txt file.
> 

And wget -e robots=off to ignore...


-- 
Orion Poplawski
Technical Manager                     303-415-9701 x222
NWRA/CoRA Division                    FAX: 303-415-9702
3380 Mitchell Lane                  orion at cora.nwra.com
Boulder, CO 80301              http://www.cora.nwra.com




More information about the fedora-devel-list mailing list