bugGNU Wget - Bugs: bug #37059, "Filename too long"...

 
 

bug #37059: "Filename too long" stops downloads when writing to WARC

Submitted by:  None
Submitted on:  Thu 09 Aug 2012 11:00:34 AM UTC  
 
Category: Program LogicSeverity: 3 - Normal
Priority: 5 - NormalStatus: None
Privacy: PublicAssigned to: None
Originator Name: Andrew JacksonOriginator Email: -unavailable-
Open/Closed: OpenRelease: trunk
Operating System: Mac OSReproducibility: Every Time
Fixed Release: NonePlanned Release: None
Regression: NoneWork Required: None
Patch Included: None

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Thu 28 Feb 2013 05:01:19 AM UTC, comment #2:

Fixed in commit "67e602". Pending release after v1.14

Darshit Shah <darnir>
Project Member
Thu 09 Aug 2012 11:05:04 AM UTC, comment #1:

I forgot to mention that this was in Wget version 1.14 (which isn't yet listed in the tracker, so I selected 'trunk'.

Anonymous
Thu 09 Aug 2012 11:00:34 AM UTC, original submission:

I'm using wget to write to a warc file, e.g.

wget --warc-file=test "http://en.wikipedia.org/wiki/Main_Page"

in general this works fine. However, for long URLs the download fails with a "Filename too long" error (see below). This doesn't really make any sense, because I'm writing to a WARC file and this has does not have the same filename limits. As a workaround, one can specify a short output filename using the -O flag, after which the WARC is written correctly (i.e. ignoring the output filename). However, this is rather awkward and it would be better if the filename length test was skipped when writing only to a WARC file.

---

wget --warc-file=longtest "http://bits.wikimedia.org/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.wmfFR2011Style%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CclickTracking%2CcollapsibleTabs%2Ccookie%2CdelayedBind%2ChighlightText%2Cjson%2CmakeCollapsible%2CmessageBox%2CmwPrototypes%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.language%2Cuser%2Cutil%7Cmediawiki.legacy.ajax%2Cmwsuggest%2Cwikibits%7Cmediawiki.page.ready&skin=vector&version=20120118T020454Z&*"
Opening WARC file ‘longtest.warc.gz’.

--2012-08-09 11:56:48-- http://bits.wikimedia.org/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.wmfFR2011Style%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CclickTracking%2CcollapsibleTabs%2Ccookie%2CdelayedBind%2ChighlightText%2Cjson%2CmakeCollapsible%2CmessageBox%2CmwPrototypes%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.language%2Cuser%2Cutil%7Cmediawiki.legacy.ajax%2Cmwsuggest%2Cwikibits%7Cmediawiki.page.ready&skin=vector&version=20120118T020454Z&*
Resolving explorer.bl.uk... 194.66.232.92
Connecting to explorer.bl.uk|194.66.232.92|:3127... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/javascript]
load.php?debug=false&lang=en&modules=ext.UserBuckets,markAsHelpful|ext.UserBuckets.AccountCreationUserBucket|ext.articleFeedback.startup|ext.articleFeedbackv5.startup|ext.gadget.wmfFR2011Style|jquery.autoEllipsis,checkboxShiftClick,clickTracking,collapsibleTabs,cookie,delayedBind,highlightText,json,makeCollapsible,messageBox,mwPrototypes,placeholder,suggestions,tabIndex|mediawiki.language,user,util|mediawiki.legacy.ajax,mwsuggest,wikibits|mediawiki.page.ready&skin=vector&version=20120118T020454Z&*: File name too long

Cannot write to ‘load.php?debug=false&lang=en&modules=ext.UserBuckets,markAsHelpful|ext.UserBuckets.AccountCreationUserBucket|ext.articleFeedback.startup|ext.articleFeedbackv5.startup|ext.gadget.wmfFR2011Style|jquery.autoEllipsis,checkboxShiftClick,clickTracking,collapsibleTabs,cookie,delayedBind,highlightText,json,makeCollapsible,messageBox,mwPrototypes,placeholder,suggestions,tabIndex|mediawiki.language,user,util|mediawiki.legacy.ajax,mwsuggest,wikibits|mediawiki.page.ready&skin=vector&version=20120118T020454Z&*’ (File name too long).

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by darnir (Posted a comment)
  • -unavailable- added by None (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    No Changes Have Been Made to This Item

    Back to the top


    Powered by Savane 3.1-cleanup