Thu 09 Aug 2012 11:00:34 AM UTC, original submission:
I'm using wget to write to a warc file, e.g.
wget --warc-file=test "http://en.wikipedia.org/wiki/Main_Page"
in general this works fine. However, for long URLs the download fails with a "Filename too long" error (see below). This doesn't really make any sense, because I'm writing to a WARC file and this has does not have the same filename limits. As a workaround, one can specify a short output filename using the -O flag, after which the WARC is written correctly (i.e. ignoring the output filename). However, this is rather awkward and it would be better if the filename length test was skipped when writing only to a WARC file.
---
wget --warc-file=longtest "http://bits.wikimedia.org/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.wmfFR2011Style%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CclickTracking%2CcollapsibleTabs%2Ccookie%2CdelayedBind%2ChighlightText%2Cjson%2CmakeCollapsible%2CmessageBox%2CmwPrototypes%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.language%2Cuser%2Cutil%7Cmediawiki.legacy.ajax%2Cmwsuggest%2Cwikibits%7Cmediawiki.page.ready&skin=vector&version=20120118T020454Z&*"
Opening WARC file ‘longtest.warc.gz’.
--2012-08-09 11:56:48-- http://bits.wikimedia.org/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.wmfFR2011Style%7Cjquery.autoEllipsis%2CcheckboxShiftClick%2CclickTracking%2CcollapsibleTabs%2Ccookie%2CdelayedBind%2ChighlightText%2Cjson%2CmakeCollapsible%2CmessageBox%2CmwPrototypes%2Cplaceholder%2Csuggestions%2CtabIndex%7Cmediawiki.language%2Cuser%2Cutil%7Cmediawiki.legacy.ajax%2Cmwsuggest%2Cwikibits%7Cmediawiki.page.ready&skin=vector&version=20120118T020454Z&*
Resolving explorer.bl.uk... 194.66.232.92
Connecting to explorer.bl.uk|194.66.232.92|:3127... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/javascript]
load.php?debug=false&lang=en&modules=ext.UserBuckets,markAsHelpful|ext.UserBuckets.AccountCreationUserBucket|ext.articleFeedback.startup|ext.articleFeedbackv5.startup|ext.gadget.wmfFR2011Style|jquery.autoEllipsis,checkboxShiftClick,clickTracking,collapsibleTabs,cookie,delayedBind,highlightText,json,makeCollapsible,messageBox,mwPrototypes,placeholder,suggestions,tabIndex|mediawiki.language,user,util|mediawiki.legacy.ajax,mwsuggest,wikibits|mediawiki.page.ready&skin=vector&version=20120118T020454Z&*: File name too long
Cannot write to ‘load.php?debug=false&lang=en&modules=ext.UserBuckets,markAsHelpful|ext.UserBuckets.AccountCreationUserBucket|ext.articleFeedback.startup|ext.articleFeedbackv5.startup|ext.gadget.wmfFR2011Style|jquery.autoEllipsis,checkboxShiftClick,clickTracking,collapsibleTabs,cookie,delayedBind,highlightText,json,makeCollapsible,messageBox,mwPrototypes,placeholder,suggestions,tabIndex|mediawiki.language,user,util|mediawiki.legacy.ajax,mwsuggest,wikibits|mediawiki.page.ready&skin=vector&version=20120118T020454Z&*’ (File name too long).
|