public requestGzipContent($mode)
| $mode | bool | Set to TRUE for enabling support/requests for gzip-encoded content, defaults to FALSE |
| No information |
If set to TRUE, the crawler will request gzip-encoded content from webservers.
This will result in reduced data traffic while crawling websites, but the CPU load
will rise because the encoded content has to be decoded locally.
By default, gzip-requests are disabled for compatibility reasons to earlier versions of phpcrawl.
Please note: If gzip-requests are disabled, but a webserver returns gzip-encoded content nevertheless,
the crawler will handle the encoded data correctly regardless of this setting.