bugfindutils - Bugs: bug #32447, Wishlist: fadvise()

 
 

bug #32447: Wishlist: fadvise()

Submitted by:  Alan Brown <stoatwblr>
Submitted on:  Sun Feb 13 03:38:16 2011  
 
Category: findSeverity: 1 - Wish
Item Group: NoneStatus: None
Privacy: PublicAssigned to: None
Originator Name: Alan BrownOpen/Closed: Open
Release: NoneFixed Release: None

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Tue Sep 24 22:14:05 2013, comment #5:

Alan, how did you measure the page cache poisoning?

James Youngman <jay>
Project Administrator
Sat May 14 23:47:19 2011, comment #4:

I see that there's no mention of this request on the gnulib mailing list by Alan yet and no further comment from Alan here. Alan, are you still thinking about this, or are you planning to bring this topic up with the gnulib developers?

James Youngman <jay>
Project Administrator
Sat Apr 2 17:09:41 2011, comment #3:

It looks to me as if, in order to do this, you would need to update the implementation of opendirat() in gnulib's file lib/fts.c.

Unfortunately, it's not a given that fts() will always need to be restrained in terms of its effect on the page cache. So, I don't know what the developers will say. But, best to start by asking them at bug-gnulib@gnu.org.

James Youngman <jay>
Project Administrator
Tue Feb 15 16:28:35 2011, comment #2:

Yes, I know it's a no-op, but POSIX_FADV_NONEED is not.

Alan Brown <stoatwblr>
Tue Feb 15 11:48:58 2011, comment #1:

Hmm. The stuff filling the page cache would be inodes and data read from directories. I suspect that posix_fadvise(2) will not help much here.

(BTW, in Linux the POSIX_FADV_NOREUSE code is currently a no-op.)

Chris(topher) Chittleborough <cchittleborough>
Sun Feb 13 03:38:16 2011, original submission:

I've discovered that find is causing pagecache poisoning on systems with large filesystems (millions of files).

This can probably be mitigated by using fadvise() to tell the OS that files/directory data doesn't need to be cached.

As far as I can tell it isn't used in any release version of find.

Can the devs look at incorporating this please?

Alan Brown <stoatwblr>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by jay (Posted a comment)
  • -unavailable- added by cchittleborough (Posted a comment)
  • -unavailable- added by stoatwblr (Submitted the item)
  • -unavailable- added by stoatwblr (findutils - fadvise)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 4 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Sat Apr 2 17:09:40 2011jaySeverity3 - Normal=>1 - Wish
    Tue Feb 15 11:51:30 2011cchittleboroughCarbon-CopyRemoved cchittleborough=>-
    Tue Feb 15 11:48:58 2011cchittleboroughCarbon-Copy-=>Added cchittleborough
    Sun Feb 13 03:38:16 2011stoatwblrCarbon-Copy-=>Added -unavailable-

    Back to the top


    Powered by Savane 3.1-cleanup