bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #37779, Make result file names insensitive...

 
 

bug #37779: Make result file names insensitive to order of input sources when using --header

Submitted by:  Drew Frank <drewfrank>
Submitted on:  Tue 20 Nov 2012 07:19:01 AM UTC  
 
Category:  None Severity:  3 - Normal
Item Group:  None Status:  Fixed
Privacy:  Public Assigned to:  None
Open/Closed:  Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Mon 26 Nov 2012 08:41:13 PM UTC, comment #2:

Fixed in [d47e130]

Ole Tange <tange>
Project Administrator
Tue 20 Nov 2012 07:58:44 AM UTC, comment #1:

Thinking about this more, it's not quite as clean as I initially thought since not all arguments may even occur in the command itself, e.g.
./parallel --results foo_ --header : echo {a} ::: a 1 ::: b 2. In such a case I would still want "b?2" to appear in the result file name. Also, some arguments might occur multiple times in the command.

Drew Frank <drewfrank>
Project Member
Tue 20 Nov 2012 07:19:01 AM UTC, original submission:

When called with both --header and --results, parallel stores job outputs in result files named according to the their corresponding input values. For example:

./parallel --results foo_ --header : echo {a} {b} ::: a 1 ::: b 2

generates the result file:

foo_stdout?a?1?b?2

where I have represented tabs with '?' for visual clarity. Now suppose the input sources were given in reverse order:

./parallel --results foo_ --header : echo {a} {b} ::: b 2 ::: a 1

Currently, parallel will write the results to

foo_stdout?b?2?a?1

Since the same command is run in both cases, it seems more natural for the file name to be based on the order that the arguments occur in the pre-substitution command. With that behavior, both of these examples would use the "a?1?b?2" ordering.

Drew Frank <drewfrank>
Project Member

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by tange (Posted a comment)
  • -email is unavailable- added by drewfrank (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    Mon 26 Nov 2012 08:41:13 PM UTC tange StatusNone => Fixed
        Open/ClosedOpen => Closed
    Tue 20 Nov 2012 07:19:57 AM UTC drewfrank SummaryMake result file names insensitive to order of input source when using --header => Make result file names insensitive to order of input sources when using --header
    Tue 20 Nov 2012 07:19:46 AM UTC drewfrank SummarySurprising behavior in result file name generation => Make result file names insensitive to order of input source when using --header

    Back to the top


    Powered by Savane 3.3