bugGNU Wget - Bugs: bug #37059, "Filename too long"...

 
 

bug #37059: "Filename too long" stops downloads when writing to WARC

Submitted by:  None
Submitted on:  Thu Aug 9 11:00:34 2012  
 
Category: Program LogicSeverity: 3 - Normal
Priority: 5 - NormalStatus: Fixed
Privacy: PublicAssigned to: None
Originator Name: Andrew JacksonOriginator Email: -unavailable-
Open/Closed: ClosedRelease: trunk
Operating System: Mac OSReproducibility: Every Time
Fixed Release: 1.15Planned Release: None
Regression: NoneWork Required: None
Patch Included: None

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Thu Dec 17 16:39:28 2015, comment #4:

Bartosz, thanks for reviewing this issue and also for finding those doublettes !

The filename is printed twice because of the redirection that happens. This is not really a bug and may be optimized in the future.

Tim Ruehsen <rockdaboot>
Project Administrator
Wed Dec 16 02:25:41 2015, comment #3:

Commit 67e602 was released in v.1.15. Confirmed that the issue is fixed. However, the long file name warning is printed twice in a row (see bug_37059_wget_v1.15_output.txt attached).

(file #35758)

Bartosz Szczesny <bszcz>
Thu Feb 28 05:01:19 2013, comment #2:

Fixed in commit "67e602". Pending release after v1.14

Darshit Shah <darnir>
Project Administrator
Thu Aug 9 11:05:04 2012, comment #1:

I forgot to mention that this was in Wget version 1.14 (which isn't yet listed in the tracker, so I selected 'trunk'.

Anonymous
Thu Aug 9 11:00:34 2012, original submission:

I'm using wget to write to a warc file, e.g.

wget --warc-file=test "http://en.wikipedia.org/wiki/Main_Page"

in general this works fine. However, for long URLs the download fails with a "Filename too long" error (see below). This doesn't really make any sense, because I'm writing to a WARC file and this has does not have the same filename limits. As a workaround, one can specify a short output filename using the -O flag, after which the WARC is written correctly (i.e. ignoring the output filename). However, this is rather awkward and it would be better if the filename length test was skipped when writing only to a WARC file.

---

wget --warc-file=longtest "http://bits.wikimedia.org/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.wmfFR2011Style%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CclickTracking%2CcollapsibleTabs%2Ccookie%2CdelayedBind%2ChighlightText%2Cjson%2CmakeCollapsible%2CmessageBox%2CmwPrototypes%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.language%2Cuser%2Cutil%7Cmediawiki.legacy.ajax%2Cmwsuggest%2Cwikibits%7Cmediawiki.page.ready&skin=vector&version=20120118T020454Z&*"
Opening WARC file ‘longtest.warc.gz’.

--2012-08-09 11:56:48-- http://bits.wikimedia.org/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.wmfFR2011Style%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CclickTracking%2CcollapsibleTabs%2Ccookie%2CdelayedBind%2ChighlightText%2Cjson%2CmakeCollapsible%2CmessageBox%2CmwPrototypes%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.language%2Cuser%2Cutil%7Cmediawiki.legacy.ajax%2Cmwsuggest%2Cwikibits%7Cmediawiki.page.ready&skin=vector&version=20120118T020454Z&*
Resolving explorer.bl.uk... 194.66.232.92
Connecting to explorer.bl.uk|194.66.232.92|:3127... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/javascript]
load.php?debug=false&lang=en&modules=ext.UserBuckets,markAsHelpful|ext.UserBuckets.AccountCreationUserBucket|ext.articleFeedback.startup|ext.articleFeedbackv5.startup|ext.gadget.wmfFR2011Style|jquery.autoEllipsis,checkboxShiftClick,clickTracking,collapsibleTabs,cookie,delayedBind,highlightText,json,makeCollapsible,messageBox,mwPrototypes,placeholder,suggestions,tabIndex|mediawiki.language,user,util|mediawiki.legacy.ajax,mwsuggest,wikibits|mediawiki.page.ready&skin=vector&version=20120118T020454Z&*: File name too long

Cannot write to ‘load.php?debug=false&lang=en&modules=ext.UserBuckets,markAsHelpful|ext.UserBuckets.AccountCreationUserBucket|ext.articleFeedback.startup|ext.articleFeedbackv5.startup|ext.gadget.wmfFR2011Style|jquery.autoEllipsis,checkboxShiftClick,clickTracking,collapsibleTabs,cookie,delayedBind,highlightText,json,makeCollapsible,messageBox,mwPrototypes,placeholder,suggestions,tabIndex|mediawiki.language,user,util|mediawiki.legacy.ajax,mwsuggest,wikibits|mediawiki.page.ready&skin=vector&version=20120118T020454Z&*’ (File name too long).

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

Attached Files

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by rockdaboot (Posted a comment)
  • -unavailable- added by bszcz (Updated the item)
  • -unavailable- added by darnir (Posted a comment)
  • -unavailable- added by None (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 4 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Thu Dec 17 16:39:28 2015rockdabootStatusNone=>Fixed
      Open/ClosedOpen=>Closed
      Fixed ReleaseNone=>1.15
    Wed Dec 16 02:25:41 2015bszczAttached File-=>Added bug_37059_wget_v1.15_output.txt, #35758

    Back to the top


    Powered by Savane 3.1-cleanup