bugGNU Wget - Bugs: bug #42180, 1.15: recursive throws...

 
 

bug #42180: 1.15: recursive throws "pathconf: Not a directory" errors

Submitter:  Keith Tyler <romulusnr>
Submitted:  Wed 23 Apr 2014 09:37:58 PM UTC
   
 
Category:  Program Logic Severity:  3 - Normal
Priority:  7 - High Status:  Needs Investigation
Privacy:  Public Assigned to:  None
Originator Name:  RomulusNR Open/Closed:  Open
Release:  None Operating System:  Mac OS
Reproducibility:  Every Time Fixed Release:  None
Planned Release:  None Regression:  Yes
Work Required:  None Patch Included:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Wed 02 Dec 2015 05:04:09 AM UTC, comment #5: 

Ran into a similar issue with version 1.6
GNU Wget 1.16.3 built on linux-gnu.


Turned out this issue was when some of the uri's were not index.htm files.

IE:
http://mydomain.com/api

Since this creates the file
mydomain.com/api

Any files under that uri cannot be created, such as:
http://mydomain.com/api/css/mystyle.css

Since api is a file not a directory, it's stuck
Adding --adjust-extension solves this issue since now instead of creating the file api it will create the file api.html

It seems the issue is with --default-page  According to the man pages, pages ending in a slash should be saved as index.html and can be changed with the --default-page option.

I'm not sure if default-page is not working or simply not being set by default anymore


gary mort <garyamort>
Fri 19 Sep 2014 12:19:42 PM UTC, comment #4: 

This also happened to me,
wget -V
GNU Wget 1.15 built on linux-gnu.

+digest +https +ipv6 +iri +large-file +nls +ntlm +opie +ssl/openssl

Wgetrc:
    /home/xxxxxxx/.wgetrc (user)
    /etc/wgetrc (system)
Locale:
    /usr/share/locale
Compile:
    gcc -DHAVE_CONFIG_H -DSYSTEM_WGETRC="/etc/wgetrc"
    -DLOCALEDIR="/usr/share/locale" -I. -I../../src -I../lib
    -I../../lib -D_FORTIFY_SOURCE=2 -I/usr/include -g -O2
    -fstack-protector --param=ssp-buffer-size=4 -Wformat
    -Werror=format-security -DNO_SSLv2 -D_FILE_OFFSET_BITS=64 -g -Wall
Link:
    gcc -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat
    -Werror=format-security -DNO_SSLv2 -D_FILE_OFFSET_BITS=64 -g -Wall
    -Wl,-Bsymbolic-functions -Wl,-z,relro -L/usr/lib -lssl -lcrypto
    -ldl -lz -lidn -luuid ftp-opie.o openssl.o http-ntlm.o
    ../lib/libgnu.a


Linux  3.13.0-35-generic #62-Ubuntu SMP Fri Aug 15 01:58:42 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux

 Anonymous
Tue 19 Aug 2014 01:33:46 PM UTC, comment #3: 

I can confirm this also occurs on wget 1.15 on Linux 3.16.1 (not just Mac OS as specified).

 William Seed <bspar>
Fri 02 May 2014 01:14:50 AM UTC, comment #2: 

I confirm this behaviour on version 1.13.4

 Anonymous
Thu 01 May 2014 08:12:45 AM UTC, comment #1: 

Hi,

What site are you trying to download? I ran wget against the current HEAD and at v1.15 using your command line without any issues.

The not a directory error was reported earlier. We'll look into this.

This was discussed on bug-wget: http://permalink.gmane.org/gmane.comp.web.wget.general/12716

 Darshit Shah <darnir>
Group administrator
Wed 23 Apr 2014 09:37:58 PM UTC, original submission:  

Only occurring in 1.15_1, not occurring in 1.14, doing a recursive wget such as:

wget -r -q www.somesite.com -l 3

will reliably return multiple "pathconf: Not a directory" errors to stderr.

In non-quiet mode, a lot of the downloads incur "Cannot save file www.somesite.com/foo/bar/baz/3: Not a directory" in stdout.

This doesn't occur in 1.14.

 Keith Tyler <romulusnr>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by garyamort (Posted a comment)
  • -email is unavailable- added by bspar (Posted a comment)
  • -email is unavailable- added by darnir (Posted a comment)
  • -email is unavailable- added by romulusnr (Submitted the item)

    •  

    Follow 2 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2014-11-18 darnir Priority5 - Normal 7 - High
    2014-05-01 darnir StatusNone Needs Investigation

    Back to the top

    Copyright © 2024 Free Software Foundation, Inc.
    Verbatim copying and distribution of this entire article is permitted in any medium, provided this notice is preserved.
    The Levitating, Meditating, Flute-playing Gnu logo is a GNU GPL'ed image provided by the Nevrax Design Team.
    Page source code

    Powered by Savane 3.13-54b4.
    Corresponding source code