bugGNU Wget - Bugs: bug #37059, "Filename too long"...

 
 

bug #37059: "Filename too long" stops downloads when writing to WARC

Submitter:  None
Submitted:  Thu 09 Aug 2012 11:00:34 AM UTC
   
 
Category:  Program Logic Severity:  3 - Normal
Priority:  5 - Normal Status:  Fixed
Privacy:  Public Assigned to:  None
Originator Name:  Andrew Jackson Originator Email:  -email is unavailable-
Open/Closed:  Closed Release:  trunk
Operating System:  Mac OS Reproducibility:  Every Time
Fixed Release:  1.15 Planned Release:  None
Regression:  None Work Required:  None
Patch Included:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Thu 17 Dec 2015 04:39:28 PM UTC, comment #4: 

Bartosz, thanks for reviewing this issue and also for finding those doublettes !

The filename is printed twice because of the redirection that happens. This is not really a bug and may be optimized in the future.

Tim Ruehsen <rockdaboot>
Group administrator
Wed 16 Dec 2015 02:25:41 AM UTC, comment #3: 

Commit 67e602 was released in v.1.15. Confirmed that the issue is fixed. However, the long file name warning is printed twice in a row (see bug_37059_wget_v1.15_output.txt attached).

(file #35758)

-X- <bszcz>
Thu 28 Feb 2013 05:01:19 AM UTC, comment #2: 

Fixed in commit "67e602". Pending release after v1.14

Darshit Shah <darnir>
Group administrator
Thu 09 Aug 2012 11:05:04 AM UTC, comment #1: 

I forgot to mention that this was in Wget version 1.14 (which isn't yet listed in the tracker, so I selected 'trunk'.

Anonymous
Thu 09 Aug 2012 11:00:34 AM UTC, original submission:  

I'm using wget to write to a warc file, e.g.

wget --warc-file=test "http://en.wikipedia.org/wiki/Main_Page"

in general this works fine. However, for long URLs the download fails with a "Filename too long" error (see below). This doesn't really make any sense, because I'm writing to a WARC file and this has does not have the same filename limits.  As a workaround, one can specify a short output filename using the -O flag, after which the WARC is written correctly (i.e. ignoring the output filename). However, this is rather awkward and it would be better if the filename length test was skipped when writing only to a WARC file.

---

wget --warc-file=longtest "http://bits.wikimedia.org/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.wmfFR2011Style%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CclickTracking%2CcollapsibleTabs%2Ccookie%2CdelayedBind%2ChighlightText%2Cjson%2CmakeCollapsible%2CmessageBox%2CmwPrototypes%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.language%2Cuser%2Cutil%7Cmediawiki.legacy.ajax%2Cmwsuggest%2Cwikibits%7Cmediawiki.page.ready&skin=vector&version=20120118T020454Z&*"
Opening WARC file ‘longtest.warc.gz’.

--2012-08-09 11:56:48--  http://bits.wikimedia.org/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.wmfFR2011Style%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CclickTracking%2CcollapsibleTabs%2Ccookie%2CdelayedBind%2ChighlightText%2Cjson%2CmakeCollapsible%2CmessageBox%2CmwPrototypes%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.language%2Cuser%2Cutil%7Cmediawiki.legacy.ajax%2Cmwsuggest%2Cwikibits%7Cmediawiki.page.ready&skin=vector&version=20120118T020454Z&*
Resolving explorer.bl.uk... 194.66.232.92
Connecting to explorer.bl.uk|194.66.232.92|:3127... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/javascript]
load.php?debug=false&lang=en&modules=ext.UserBuckets,markAsHelpful|ext.UserBuckets.AccountCreationUserBucket|ext.articleFeedback.startup|ext.articleFeedbackv5.startup|ext.gadget.wmfFR2011Style|jquery.autoEllipsis,checkboxShiftClick,clickTracking,collapsibleTabs,cookie,delayedBind,highlightText,json,makeCollapsible,messageBox,mwPrototypes,placeholder,suggestions,tabIndex|mediawiki.language,user,util|mediawiki.legacy.ajax,mwsuggest,wikibits|mediawiki.page.ready&skin=vector&version=20120118T020454Z&*: File name too long

Cannot write to ‘load.php?debug=false&lang=en&modules=ext.UserBuckets,markAsHelpful|ext.UserBuckets.AccountCreationUserBucket|ext.articleFeedback.startup|ext.articleFeedbackv5.startup|ext.gadget.wmfFR2011Style|jquery.autoEllipsis,checkboxShiftClick,clickTracking,collapsibleTabs,cookie,delayedBind,highlightText,json,makeCollapsible,messageBox,mwPrototypes,placeholder,suggestions,tabIndex|mediawiki.language,user,util|mediawiki.legacy.ajax,mwsuggest,wikibits|mediawiki.page.ready&skin=vector&version=20120118T020454Z&*’ (File name too long).

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

Attached Files

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by rockdaboot (Posted a comment)
  • -email is unavailable- added by bszcz (Updated the item)
  • -email is unavailable- added by darnir (Posted a comment)
  • -email is unavailable- added by None (Submitted the item)
  •  

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2015-12-17 rockdaboot StatusNone Fixed
        Open/ClosedOpen Closed
        Fixed ReleaseNone 1.15
    2015-12-16 bszcz Attached File- Added bug_37059_wget_v1.15_output.txt, #35758

    Back to the top

    Powered by Savane 3.13-cf05.
    Corresponding source code