Tool 210: Web spider on command line (stay in same directory)
Description:
This tool spiders a HTTP or FTP url. 'Spidering' an url means to
download the url, read the new urls it contains, download them, and so
on recursively.
It stops when all url of requested directory have been downloaded.
For example, 'http://s/dir/page.html', will retrieve all files in
'http://s/dir/'.
Synonyms:
curl, wget
Usage:
netwox 210 -u uri [-r dir] [-v|+v]
Parameters:
parameter |
description |
example |
-u|--url uri |
url to download |
http://www.example.com/ |
-r|--rootdir dir |
local root directory |
./spider |
-v|--verbose|+v|--no-verbose |
be verbose |
|
Examples:
netwox 210 -u "http://www.example.com/"
netwox 210 --url "http://www.example.com/"