WebCopy
is a robot which retrieves a document tree, and (optionally) stores
local copies.
- WebCopy retrieves documents from the Web and puts them in the
current directory by default (or standard output with -o
option, or another directory with the -w option).
- WebCopy can retrieve a document tree (with the -r
recurse option or the -l follow links option),
but will not load documents from a different server.
- WebCopy will wait for 30 seconds (or the number given with the
-r options) between connections, to avoid overloading
a server.
- WebCopy retrieves exactly the requested documents.
It does not check /robots.txt to verify that this is
permissible for a robot.
