bugGNU Wget - Bugs: bug #38844, performace issues when saving a...

 
 

bug #38844: performace issues when saving a http iptv stream on a SD card

Submitted by:  None
Submitted on:  Sun 28 Apr 2013 08:17:26 PM UTC  
 
Category: Crash/Freeze/InfloopSeverity: 3 - Normal
Priority: 5 - NormalStatus: None
Privacy: PublicAssigned to: None
Originator Name: Originator Email: -unavailable-
Open/Closed: OpenRelease: trunk
Operating System: GNU/LinuxReproducibility: Every Time
Fixed Release: NonePlanned Release: None
Regression: NoneWork Required: None
Patch Included: None

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Mon 29 Apr 2013 03:45:51 AM UTC, comment #1:

I see brief download stalls followed by a short speed spike as the download catches up. Are the writing operations blocking?

Anonymous
Sun 28 Apr 2013 08:17:26 PM UTC, original submission:

wget $source -O test.ts fails after a while.
while
wget $source -O - | dd obs=16M of=test.ts works fine and runs as log as I want.

It usually fails with a success message ("download complete"),
but sometimes it fails with "Cannot write to ‘test.ts’ (Success)." and return value 3

wget --version: "GNU Wget 1.14 built on linux-gnu." obtained from Ubuntu 13.03 Raring

the source has a bitrate around 462 kB/s (one DVB-T channel streamed by getstream over a local network), cannot be seeked.
The card should be good up to 4MB/s, as long as whole units (erase blocks?) are written, tiny and frequent writes can be an issue, however.

I tried saving the stream into a ramdisk and copying it over onto the card.
The copying step took roughly 1/10 of the recording step, matching the declared speed.

I tried running wget with "eatmydata" (removes any syncing), it didn't change anything

The rest of this message is a log of wget --debug $source -O test.ts

Setting --output-document (outputdocument) to test.ts
DEBUG output created by Wget 1.14 on linux-gnu.

URI encoding = ‘UTF-8’
--2013-04-28 21:36:45-- http://<source>/<path>
Connecting to <source>... connected.
Created socket 5.
Releasing 0x0000000000e43380 (new refcount 0).
Deleting unused 0x0000000000e43380.

---request begin---
GET /8 HTTP/1.1
User-Agent: Wget/1.14 (linux-gnu)
Accept: /
Host: <source>
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 200 OK
Date: Sun, 28 Apr 2013 19:36:49 GMT
Content-Type: application/octet-stream
Pragma: no-cache
Cache-Control: no-cache
Transfer-Encoding: chunked
Connection: keep-alive

---response end---
200 OK
Registered socket 5 for persistent reuse.
Length: unspecified [application/octet-stream]
Saving to: ‘test.ts’

[ <=> ] 17,496,784 289KB/s in 38s

Disabling further reuse of socket 5.
Closed fd 5
2013-04-28 21:37:23 (445 KB/s) - Read error at byte 17496784 (Success).Retrying.

--2013-04-28 21:37:24-- (try: 2) http://10.0.0.132:3000/8
Connecting to 10.0.0.132:3000... connected.
Created socket 5.
Releasing 0x0000000000e42f10 (new refcount 0).
Deleting unused 0x0000000000e42f10.

---request begin---
GET /8 HTTP/1.1
Range: bytes=17496784-
User-Agent: Wget/1.14 (linux-gnu)
Accept: /
Host: <source>
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 200 OK
Date: Sun, 28 Apr 2013 19:37:28 GMT
Content-Type: application/octet-stream
Pragma: no-cache
Cache-Control: no-cache
Transfer-Encoding: chunked
Connection: keep-alive

---response end---
200 OK
Registered socket 5 for persistent reuse.
Length: unspecified [application/octet-stream]
Saving to: ‘test.ts’

[ <=> ] 0 --.-K/s in 0.01s

Disabling further reuse of socket 5.
Closed fd 5

Cannot write to ‘test.ts’ (Success).

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

CC list is empty

 

Please enter the title of George Orwell's famous dystopian book (it's a date):

 

 

No Changes Have Been Made to This Item

Back to the top


Powered by Savane 3.1-cleanup