Webmirror 2.0

believe Content-length

or

unbelieve Content-length
When a pagesizelimit is defined the pages that are larger than the limit are not retrieved. The retrieval process can stop for the certain page when the header field Content-length is larger than the limit or when the download process physically reaches the limit.

However some webservers report erroneous and extraordinarily large content length values in the http header. If you face this problem and still want to limit the maximal page size say

unbelieve Content-length
This will force the program to start the download of the page even if the size reported in the http header is too large. If the page is really large it will be abandoned. If the file has moderate size it is downloaded even when the reported size is too large.

The opposite of this command is

believe Content-length
which makes the program to believe the reported content length.

Use this command only if you face the problem described above.

TOC