bugGNU Wget - Bugs: bug #20947, trunk:2369 dump on retrieve a...

 
 

bug #20947: trunk:2369 dump on retrieve a partial content file

Submitted by:  None
Submitted on:  Sat 01 Sep 2007 01:04:35 AM UTC  
 
Category: Crash/Freeze/InfloopSeverity: 3 - Normal
Priority: 5 - NormalStatus: Fixed In Repository
Privacy: PublicAssigned to: None
Originator Name: Originator Email: -unavailable-
Open/Closed: ClosedRelease: trunk
Operating System: Microsoft WindowsReproducibility: Every Time
Fixed Release: NonePlanned Release: 1.11.1
Regression: NoneWork Required: 1 - Days
Patch Included: None

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

(Jump to the original submission Jump to the original submission)

Thu 31 Jan 2008 09:04:09 AM UTC, comment #8:

I believe this may have been fixed in http://hg.addictivecode.org/wget/1.11, changeset d5cc76b8b225 (note that the Subversion repository is no longer tracking new changes).

If it has not been fixed, please provide a real, concrete test that I can use to try to reproduce the problem directly.

Micah Cowan <micahcowan>
Thu 31 Jan 2008 08:13:30 AM UTC, comment #7:

Probably fixed with fix for bug 21437.

Micah Cowan <micahcowan>
Thu 27 Sep 2007 06:16:41 PM UTC, comment #6:

svn 2383 do this too

goul_dukat
Sun 09 Sep 2007 08:43:25 PM UTC, comment #5:

Much better, thanks!

Micah Cowan <micahcowan>
Sun 09 Sep 2007 06:19:08 PM UTC, comment #4:

let see if i can be more specific, when you start for the first time a download ( ex: wget -c -S http://gaming.ngi.it/test.zip )
you're receiving from the server this header :

---
--19:59:53-- http://gaming.ngi.it/test.zip
Resolving gaming.ngi.it... 88.149.128.30
Connecting to gaming.ngi.it|88.149.128.30|:80... connected.
HTTP request sent, awaiting response...
HTTP/1.1 200 OK
Date: Sun, 09 Sep 2007 18:00:08 GMT
Server: Apache
Last-Modified: Sun, 04 Sep 2005 07:51:10 GMT
ETag: "9197461-6400000-75463780"
Accept-Ranges: bytes
Content-Length: 104857600
Connection: close
Content-Type: application/zip
Length: 104857600 (100M) [application/zip]
Saving to: `test.zip'

3% [> ] 3,613,764 36.3K/s eta 70m 50s
---

you see in this header contain the field "Content-Length:" who it's been used bye wget to draw and calculate the gauge and eta on the bottom.
when wget go in timeout, or connection is resetted, or other, wget do a retry of that file, but this time instead to re download from the beginning he do a partial content retrieve, so this time you obtain an header like this :

---
20:05:43 (47.6 KB/s) - Read error at byte 1118109/104857600 (Connection reset by
peer). Retrying.

--20:05:43-- (try: 2) http://gaming.ngi.it/test.zip
Connecting to gaming.ngi.it|88.149.128.30|:80... connected.
HTTP request sent, awaiting response...
HTTP/1.1 206 Partial Content
Date: Sun, 09 Sep 2007 18:05:59 GMT
Server: Apache
Last-Modified: Sun, 04 Sep 2005 07:51:10 GMT
ETag: "9197461-6400000-75463780"
Accept-Ranges: bytes
Content-Length: 103739491
Content-Range: bytes 1118109-104857599/104857600
Connection: close
Content-Type: application/zip
Length: 104857600 (100M), 103739491 (99M) remaining [application/zip]
Saving to: `test.zip'

1% [ ] 1,360,155 25.1K/s eta 80m 36s^
---

you see now in this header you found the "Content-Length:" field and the "Content-Range:" field, now wget on this server and on this partial content retrieve it's not bug because he find the "Content-Length:" field who he use to calculate gauge and eta.
BUT on some server like "http://www.rfactorcentral.com" the HTTP server on a partial content retrieve do not insert in the header the "Content-Length:" field, making wget incapable to draw the correct gauge and eta, and making him DUMP on the end of the connection trying to calculate the average bandwidth and time spent in download ( i think on a division bye 0 ).

so to avoid this and to make wget behave better on this problem is possible to use the 3th value of the "Content-Range:" field who is the same value and think of the "Content-Length:" field, fixing the problem raised bye a server who don't send the "Content-Length:" field on a partial content retrieval header message 206.

now you understand better this ?

Anonymous
Sun 09 Sep 2007 03:37:27 AM UTC, comment #3:

Sorry, but I couldn't understand a single word of that; could you try again?

Micah Cowan <micahcowan>
Sun 09 Sep 2007 03:24:25 AM UTC, comment #2:

wget bugs gauge + eta + dump at connection end, when the server don't return in the 206 header the voice:

Content-Length: n

wget to avoid this problem need to fall back on use 3th value of,

Content-Range:

header voice.

Anonymous
Sun 02 Sep 2007 07:35:28 PM UTC, comment #1:

version 2376 do it too, im cecking every trunk whos been posted for win.

Anonymous
Sat 01 Sep 2007 01:04:35 AM UTC, original submission:

this partial file generate the dump, and he have the strange behavior of starting the gauge at full and build up from it.
i tried with other http file on asus server but that don't generate this error, nor the gauge problem.

i have stripped with xxx the private data sid/login cookie, if needed it contact me.

command line:
wget.exe -d -e contentdisposition=on -S -N -t0 -T15 -w5 -c --retry-connrefused --referer="http://www.rfactorcentral.com/detail.cfm?ID=Snetterton%201964" --load-cookies="xxx\cookies.txt" --header="Cookie:CFGLOBALS=xxx; CFCLIENT_RCENTRAL=; CFID=xxx; RFCIDX=xxx; CFTOKEN=xxx; RFCENTRALID=xxx;" --input-file="xxx\flashgot-6.fgt" > out.txt 2>&1

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

Attached Files
file #13854:  flashgot-6.fgt added by None (84B - application/octet-stream)
file #13855:  634C670.dmp added by None (80KiB - application/octet-stream)
file #13856:  cca4_appcompat.txt added by None (7KiB - text/plain)
file #13857:  out.txt added by None (8KiB - text/plain)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by goul_dukat (Posted a comment)
  • -unavailable- added by micahcowan (Posted a comment)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 9 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Thu 31 Jan 2008 09:05:38 AM UTCmicahcowanOpen/ClosedOpen=>Closed
    Thu 31 Jan 2008 09:04:09 AM UTCmicahcowanStatusNone=>Fixed In Repository
    Thu 31 Jan 2008 08:13:29 AM UTCmicahcowanPlanned Release1.12=>1.11.1
    Tue 25 Sep 2007 10:56:31 PM UTCmicahcowanWork RequiredNone=>1 - Days
    Mon 24 Sep 2007 10:27:13 PM UTCmicahcowanPlanned ReleaseNone=>1.12
    Sat 01 Sep 2007 01:04:35 AM UTCNoneAttached File-=>Added flashgot-6.fgt, #13854
      Attached File-=>Added 634C670.dmp, #13855
      Attached File-=>Added cca4_appcompat.txt, #13856
      Attached File-=>Added out.txt, #13857

    Back to the top


    Powered by Savane 3.1-cleanup1