bugGNU Wget - Bugs: bug #37059, "Filename too long"...

 
 

bug #37059: "Filename too long" stops downloads when writing to WARC

Submitted by:  None
Submitted on:  Thu 09 Aug 2012 11:00:34 AM UTC  
 
Category: Program LogicSeverity: 3 - Normal
Priority: 5 - NormalStatus: Fixed
Privacy: PublicAssigned to: None
Originator Name: Andrew JacksonOriginator Email: -unavailable-
Open/Closed: ClosedRelease: trunk
Operating System: Mac OSReproducibility: Every Time
Fixed Release: 1.15Planned Release: None
Regression: NoneWork Required: None
Patch Included: None

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Thu 17 Dec 2015 04:39:28 PM UTC, comment #4:

Bartosz, thanks for reviewing this issue and also for finding those doublettes !

The filename is printed twice because of the redirection that happens. This is not really a bug and may be optimized in the future.

Tim Ruehsen <rockdaboot>
Project Administrator
Wed 16 Dec 2015 02:25:41 AM UTC, comment #3:

Commit 67e602 was released in v.1.15. Confirmed that the issue is fixed. However, the long file name warning is printed twice in a row (see bug_37059_wget_v1.15_output.txt attached).

(file #35758)

Bartosz Szczesny <bszcz>
Thu 28 Feb 2013 05:01:19 AM UTC, comment #2:

Fixed in commit "67e602". Pending release after v1.14

Darshit Shah <darnir>
Project Administrator
Thu 09 Aug 2012 11:05:04 AM UTC, comment #1:

I forgot to mention that this was in Wget version 1.14 (which isn't yet listed in the tracker, so I selected 'trunk'.

Anonymous
Thu 09 Aug 2012 11:00:34 AM UTC, original submission:

I'm using wget to write to a warc file, e.g.

wget --warc-file=test "http://en.wikipedia.org/wiki/Main_Page"

in general this works fine. However, for long URLs the download fails with a "Filename too long" error (see below). This doesn't really make any sense, because I'm writing to a WARC file and this has does not have the same filename limits. As a workaround, one can specify a short output filename using the -O flag, after which the WARC is written correctly (i.e. ignoring the output filename). However, this is rather awkward and it would be better if the filename length test was skipped when writing only to a WARC file.

---

wget --warc-file=longtest "http://bits.wikimedia.org/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.wmfFR2011Style%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CclickTracking%2CcollapsibleTabs%2Ccookie%2CdelayedBind%2ChighlightText%2Cjson%2CmakeCollapsible%2CmessageBox%2CmwPrototypes%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.language%2Cuser%2Cutil%7Cmediawiki.legacy.ajax%2Cmwsuggest%2Cwikibits%7Cmediawiki.page.ready&skin=vector&version=20120118T020454Z&*"
Opening WARC file ‘longtest.warc.gz’.

--2012-08-09 11:56:48-- http://bits.wikimedia.org/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.wmfFR2011Style%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CclickTracking%2CcollapsibleTabs%2Ccookie%2CdelayedBind%2ChighlightText%2Cjson%2CmakeCollapsible%2CmessageBox%2CmwPrototypes%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.language%2Cuser%2Cutil%7Cmediawiki.legacy.ajax%2Cmwsuggest%2Cwikibits%7Cmediawiki.page.ready&skin=vector&version=20120118T020454Z&*
Resolving explorer.bl.uk... 194.66.232.92
Connecting to explorer.bl.uk|194.66.232.92|:3127... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/javascript]
load.php?debug=false&lang=en&modules=ext.UserBuckets,markAsHelpful|ext.UserBuckets.AccountCreationUserBucket|ext.articleFeedback.startup|ext.articleFeedbackv5.startup|ext.gadget.wmfFR2011Style|jquery.autoEllipsis,checkboxShiftClick,clickTracking,collapsibleTabs,cookie,delayedBind,highlightText,json,makeCollapsible,messageBox,mwPrototypes,placeholder,suggestions,tabIndex|mediawiki.language,user,util|mediawiki.legacy.ajax,mwsuggest,wikibits|mediawiki.page.ready&skin=vector&version=20120118T020454Z&*: File name too long

Cannot write to ‘load.php?debug=false&lang=en&modules=ext.UserBuckets,markAsHelpful|ext.UserBuckets.AccountCreationUserBucket|ext.articleFeedback.startup|ext.articleFeedbackv5.startup|ext.gadget.wmfFR2011Style|jquery.autoEllipsis,checkboxShiftClick,clickTracking,collapsibleTabs,cookie,delayedBind,highlightText,json,makeCollapsible,messageBox,mwPrototypes,placeholder,suggestions,tabIndex|mediawiki.language,user,util|mediawiki.legacy.ajax,mwsuggest,wikibits|mediawiki.page.ready&skin=vector&version=20120118T020454Z&*’ (File name too long).

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

Attached Files

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by rockdaboot (Posted a comment)
  • -unavailable- added by bszcz (Updated the item)
  • -unavailable- added by darnir (Posted a comment)
  • -unavailable- added by None (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 4 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Thu 17 Dec 2015 04:39:28 PM UTCrockdabootStatusNone=>Fixed
      Open/ClosedOpen=>Closed
      Fixed ReleaseNone=>1.15
    Wed 16 Dec 2015 02:25:41 AM UTCbszczAttached File-=>Added bug_37059_wget_v1.15_output.txt, #35758

    Back to the top


    Powered by Savane 3.1-cleanup