bugGNU Wget - Bugs: bug #38844, performace issues when saving a...

 
 

bug #38844: performace issues when saving a http iptv stream on a SD card

Submitter:  None
Submitted:  Sun 28 Apr 2013 08:17:26 PM UTC
   
 
Category:  Crash/Freeze/Infloop Severity:  3 - Normal
Priority:  5 - Normal Status:  None
Privacy:  Public Assigned to:  None
Originator Name:  Originator Email:  -email is unavailable-
Open/Closed:  Open Release:  trunk
Operating System:  GNU/Linux Reproducibility:  Every Time
Fixed Release:  None Planned Release:  None
Regression:  None Work Required:  None
Patch Included:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Mon 29 Apr 2013 03:45:51 AM UTC, comment #1: 

I see brief download stalls followed by a short speed spike as the download catches up.  Are the writing operations blocking?

Anonymous
Sun 28 Apr 2013 08:17:26 PM UTC, original submission:  

wget $source -O test.ts   fails after a while.
while
wget $source -O - | dd obs=16M of=test.ts   works fine and runs as log as I want.

It usually fails with a success message ("download complete"),
but sometimes it fails with "Cannot write to ‘test.ts’ (Success)." and return value 3

wget --version: "GNU Wget 1.14 built on linux-gnu." obtained from Ubuntu 13.03 Raring

the source has a bitrate around 462 kB/s  (one DVB-T channel streamed by getstream over a local network), cannot be seeked.
The card should be good up to 4MB/s, as long as whole units (erase blocks?) are written, tiny and frequent writes can be an issue, however.

I tried saving the stream into a ramdisk and copying it over onto the card.
The copying step took roughly 1/10 of the recording step, matching the declared speed.

I tried running wget with "eatmydata" (removes any syncing), it didn't change anything


The rest of this message is a log of wget --debug $source -O test.ts



    Setting --output-document (outputdocument) to test.ts
    DEBUG output created by Wget 1.14 on linux-gnu.
    
    URI encoding = ‘UTF-8’
    --2013-04-28 21:36:45--  http://<source>/<path>
    Connecting to <source>... connected.
    Created socket 5.
    Releasing 0x0000000000e43380 (new refcount 0).
    Deleting unused 0x0000000000e43380.
    
    ---request begin---
    GET /8 HTTP/1.1
    User-Agent: Wget/1.14 (linux-gnu)
    Accept: /
    Host: <source>
    Connection: Keep-Alive
    
    ---request end---
    HTTP request sent, awaiting response...
    ---response begin---
    HTTP/1.1 200 OK
    Date: Sun, 28 Apr 2013 19:36:49 GMT
    Content-Type: application/octet-stream
    Pragma: no-cache
    Cache-Control: no-cache
    Transfer-Encoding: chunked
    Connection: keep-alive
    
    ---response end---
    200 OK
    Registered socket 5 for persistent reuse.
    Length: unspecified [application/octet-stream]
    Saving to: ‘test.ts’
    
        [                                                                                                                                                             <=>                          ] 17,496,784   289KB/s   in 38s   
    
    Disabling further reuse of socket 5.
    Closed fd 5
    2013-04-28 21:37:23 (445 KB/s) - Read error at byte 17496784 (Success).Retrying.
    
    --2013-04-28 21:37:24--  (try: 2)  http://10.0.0.132:3000/8
    Connecting to 10.0.0.132:3000... connected.
    Created socket 5.
    Releasing 0x0000000000e42f10 (new refcount 0).
    Deleting unused 0x0000000000e42f10.
    
    ---request begin---
    GET /8 HTTP/1.1
    Range: bytes=17496784-
    User-Agent: Wget/1.14 (linux-gnu)
    Accept: /
    Host: <source>
    Connection: Keep-Alive
    
    ---request end---
    HTTP request sent, awaiting response...
    ---response begin---
    HTTP/1.1 200 OK
    Date: Sun, 28 Apr 2013 19:37:28 GMT
    Content-Type: application/octet-stream
    Pragma: no-cache
    Cache-Control: no-cache
    Transfer-Encoding: chunked
    Connection: keep-alive
    
    ---response end---
    200 OK
    Registered socket 5 for persistent reuse.
    Length: unspecified [application/octet-stream]
    Saving to: ‘test.ts’
    
        [ <=>                                                                                                                                                                                      ] 0           --.-K/s   in 0.01s 
    
    Disabling further reuse of socket 5.
    Closed fd 5
    
    Cannot write to ‘test.ts’ (Success).


Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

CC list is empty

 

No changes have been made to this item

Back to the top

Powered by Savane 3.13-cf05.
Corresponding source code