Tool 138: Web spider (use configuration file created by tool 137)

Description:

  This tool spiders a HTTP or FTP url. 'Spidering' an url means to
  download the url, read the new urls it contains, download them, and so
  on recursively.
  It needs a configuration file created with tool 137.
  It decides which url to download base on rules in configuration file.

Synonyms:

curl, wget

Usage:

netwox 138 -f file

Parameters:

parameter	description	example
`-f\|--conffile file`	configuration file	srcfile.txt

Examples:

netwox 138 -f "srcfile.txt"

netwox 138 --conffile "srcfile.txt"