bugGNU Parallel - Bugs: bug #37779, Make result file names insensitive...

 
 

bug #37779: Make result file names insensitive to order of input sources when using --header

Submitter:  Drew Frank <drewfrank>
Submitted:  Tue 20 Nov 2012 07:19:01 AM UTC
   
 
Category:  None Severity:  3 - Normal
Item Group:  None Status:  Fixed
Privacy:  Public Assigned to:  None
Open/Closed:  Closed
* Mandatory Fields

Add a New Comment Rich Markup
   

Mon 26 Nov 2012 08:41:13 PM UTC, comment #2: 

Fixed in [d47e130]

Ole Tange <tange>
Group administrator
Tue 20 Nov 2012 07:58:44 AM UTC, comment #1: 

Thinking about this more, it's not quite as clean as I initially thought since not all arguments may even occur in the command itself, e.g.
./parallel --results foo_ --header : echo {a} ::: a 1 ::: b 2. In such a case I would still want "b?2" to appear in the result file name. Also, some arguments might occur multiple times in the command.

Drew Frank <drewfrank>
Group Member
Tue 20 Nov 2012 07:19:01 AM UTC, original submission:  

When called with both --header and --results, parallel stores job outputs in result files named according to the their corresponding input values. For example:

   ./parallel --results foo_ --header : echo {a} {b} ::: a 1 ::: b 2

generates the result file:

   foo_stdout?a?1?b?2

where I have represented tabs with '?' for visual clarity. Now suppose the input sources were given in reverse order:

   ./parallel --results foo_ --header : echo {a} {b} ::: b 2 ::: a 1

Currently, parallel will write the results to

   foo_stdout?b?2?a?1

Since the same command is run in both cases, it seems more natural for the file name to be based on the order that the arguments occur in the pre-substitution command. With that behavior, both of these examples would use the "a?1?b?2" ordering.

Drew Frank <drewfrank>
Group Member

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by tange (Posted a comment)
  • -email is unavailable- added by drewfrank (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2012-11-26 tange StatusNone Fixed
        Open/ClosedOpen Closed
    2012-11-20 drewfrank SummaryMake result file names insensitive to order of input source when using --header Make result file names insensitive to order of input sources when using --header
    2012-11-20 drewfrank SummarySurprising behavior in result file name generation Make result file names insensitive to order of input source when using --header

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code