On Fri, 11 Sep 2009 21:02:10 +0100, Robin wrote:
I am having trouble downloading the raw monthly archives of fedora-test-list. For example:
[greenrd@fedora shm]$ wget --no-cache 'https://www.redhat.com/archives/fedora-test-list/2009-August.txt.gz' --2009-09-11 20:58:30-- https://www.redhat.com/archives/fedora-test-list/2009-August.txt.gz Resolving www.redhat.com... 88.221.160.112 Connecting to www.redhat.com|88.221.160.112|:443... connected. HTTP request sent, awaiting response... 200 OK Length: unspecified [application/x-gzip] Saving to: `2009-August.txt.gz'
[ <=> ] 43,213 --.-K/s in 0.04s2009-09-11 20:58:31 (946 KB/s) - `2009-August.txt.gz' saved [43213]
The resultant file only contains 1 email (uncompressed).
Looks like a server error. Try multiple times with option -c, although that will corrupt the downloaded file (but demonstrate that a larger file is offered). It's reproducible here.
Also with "curl -C - -O ...", which shows behaviour like wget -c ...:
$ curl -C - -O https://www.redhat.com/archives/fedora-test-list/2009-August.txt.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 43213 0 43213 0 0 33946 0 --:--:-- 0:00:01 --:--:-- 46565 curl: (18) transfer closed with outstanding read data remaining $ curl -C - -O https://www.redhat.com/archives/fedora-test-list/2009-August.txt.gz ** Resuming transfer from byte position 43213 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 2267k 100 2267k 0 0 490k 0 0:00:04 0:00:04 --:--:-- 525k $ gunzip 2009-August.txt.gz
gzip: 2009-August.txt.gz: not in gzip format $ file 2009-August.txt.gz 2009-August.txt.gz: data
The first 43K is an uncompressed rawhide report (that alone is a server error already). The second download attempt appends the compressed archive for August.