windows - Downloading entire web pages within domain

08
2014-07
  • Nickon

    This question already has an answer here:

    • Answers
  • Cybertox

    Free Download Manager's HTML Spider feature might be what you're looking for. It even supports user login and password.

    enter image description here


    • Related Question

    windows - Call but not download a page with wget
  • Andreas Grech

    I was wondering if there was any argument that allowed me to use wget and "call" a page, but without downloading the page.

    The problem is that when you call wget on a page, it downloads it to the folder wget.exe resides in, but I don't want to download a file every time I use it.


    • Related Answers
  • John T

    Use the --spider option.

    --spider

When invoked with this option, Wget will behave as a Web spider,
which means that it will not download the pages, just check that
they are there. You can use it to check your bookmarks, e.g. with:

            wget --spider --force-html -i bookmarks.html
  • bzlm

    GNU Wget is a free software package for retrieving files using HTTP, HTTPS and FTP. If you are not actually interested in retrieving files, you may be better off using a tool like cURL, which may have more fine-tuned support for what you want to do. (Using the --spider switch in Wget, for example, is an experimental hack according to the documentation.)