bugGNU Parallel - Bugs: bug #45025, --pipe --retries does not...

 
 

bug #45025: --pipe --retries does not reschedule on other host

Submitter:  Ole Tange <tange>
Submitted:  Tue 05 May 2015 02:58:29 PM UTC
   
 
Category:  None Severity:  3 - Normal
Item Group:  None Status:  Fixed
Privacy:  Public Assigned to:  tange
Open/Closed:  Closed
* Mandatory Fields

Add a New Comment Rich Markup
   

Jump to the original submission

Sun 13 Dec 2015 12:56:01 AM UTC, comment #6: 

Fixed in [09dcafc].

Ole Tange <tange>
Group administrator
Sat 12 Dec 2015 10:53:52 PM UTC, comment #5: 

Short example:

seq 1 30003| ppar --retries 2 --block 100k -S a.a,: --pipe 'wc;hostname'

Ole Tange <tange>
Group administrator
Sun 25 Oct 2015 08:19:05 AM UTC, comment #4: 

Can we reuse $job->{'stdin_buffer'}

Ole Tange <tange>
Group administrator
Sun 25 Oct 2015 06:43:56 AM UTC, comment #3: 

One way:

if --retry:
  # store a copy of the block before fork.
  $job->set_block(substr($$record_ref,$endpos,length $$record_ref));



Ole Tange <tange>
Group administrator
Sun 25 Oct 2015 06:32:33 AM UTC, comment #2: 

Data is given to write_record_to_pipe, which forks and writes to pipe and exits.

When returning from write_record_to_pipe (but before data is written) the buffer is shortened.

Some redesign is needed before this bug can be fixed.

Ole Tange <tange>
Group administrator
Sun 07 Jun 2015 10:39:07 PM UTC, comment #1: 

Better example:

seq 1 300030| parallel --retries 2 -S no.server,: --pipe 'wc;hostname'

It should run everything on : when retrying.

Ole Tange <tange>
Group administrator
Tue 05 May 2015 02:58:29 PM UTC, original submission:  

seq 1 300030| parallel  --retries 2 -S redhat9.t,:  --pipe 'wc;hostname'

Re-schedules on redhat9.t and not on :.

Ole Tange <tange>
Group administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by tange (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 2 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2015-12-13 tange StatusConfirmed Fixed
        Open/ClosedOpen Closed

    Back to the top

    Powered by Savane 3.13-02a9.
    Corresponding source code