mainGNU tar - Support: sr #110535, implement pbzip2, pgzip or pigz

 
 

sr #110535: implement pbzip2, pgzip or pigz

Submitter:  bellencontre <bellenco>
Submitted:  Wed 08 Sep 2021 03:10:12 PM UTC
   
 
Category:  None Priority:  5 - Normal
Severity:  3 - Normal Status:  None
Privacy:  Public Assigned to:  None
Open/Closed:  Open Operating System:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Sat 11 Feb 2023 01:27:01 PM UTC, comment #1: 

No multithreaded version of tar is planned.

Sergey Poznyakoff <gray>
Group administrator
Wed 08 Sep 2021 03:10:12 PM UTC, original submission:  

Dear all,
i worked on hpc system with some nodes dedicated to be server files. On these servers some operations of maintenance are often performed by administrators (at least wwekly but i could be nighly). Once of these operation consist in 'tar xvfj ...' on volumes of ~1 or 2 To of larges files ( ~10 Go to 100go )
i have compiled latest version of tar using ./configure --with-bz2=<my own  install of latest pbzip2 based on latest version of bzip2>

It constitutes an actual gain of time on node with 12 cores :
12 sec for 1 Go ASCII file instead of 1m44s with classical tar

Before going further, i am wondering if someone in tar project have a look on this question a  'multithreaded version of tar'
In this case, any advices or remarks to share ?
thanks a lot.

i think i will continue and stabilize before propage this idea to several custumers ( national computing center...)

i am ope to discuss about it

bellencontre <bellenco>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by gray (Posted a comment)
  • -email is unavailable- added by bellenco (Submitted the item)
  • -email is unavailable- added by bellenco
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follows 1 latest change.

    Date Changed by Updated Field Previous Value => Replaced by
    2021-09-08 bellenco Carbon-Copy- Added -email is unavailable-

    Back to the top

    Powered by Savane 3.13-b921.
    Corresponding source code