Tool 139: Web spider on command line (fully recursive)

Description:

  This tool spiders a HTTP or FTP url. 'Spidering' an url means to
  download the url, read the new urls it contains, download them, and so
  on recursively.
  It stops when all url have been downloaded. So it is not suitable for
  web sites with outgoing web branches (use tool 210 or 138 instead).

Synonyms:

curl, wget

Usage:

netwox 139 -u uri [-r dir] [-v|+v]

Parameters:

parameter	description	example
`-u\|--url uri`	url to download	http://www.example.com/
`-r\|--rootdir dir`	local root directory	./spider
`-v\|--verbose\|+v\|--no-verbose`	be verbose

Examples:

netwox 139 -u "http://www.example.com/"

netwox 139 --url "http://www.example.com/"