bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #35102, --resume with --joblog

 
 

bug #35102: --resume with --joblog

Submitted by:  Ole Tange <tange>
Submitted on:  Sun 18 Dec 2011 03:53:58 PM UTC  
 
Category: NoneSeverity: 1 - Wish
Item Group: NoneStatus: Fixed
Privacy: PublicAssigned to: Ole Tange <tange>
Open/Closed: Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Sat 07 Jan 2012 03:31:50 AM UTC, comment #1:

Fixed in [fc65ca9] so you can do this:

timeout -k 1 1 parallel -j2 --resume --joblog /tmp/joblog2 sleep {} ::: 1.1 2.2 3.3 4.4
parallel -j2 --resume --joblog /tmp/joblog2 sleep {} ::: 1.1 2.2 3.3 4.4;

Ole Tange <tange>
Project AdministratorIn charge of this item.
Sun 18 Dec 2011 03:53:58 PM UTC, original submission:

Make it possible to --resume a batch that was interrupted (reboot or other). Look for the seq's in --joblog. If the seq of the current job already exists: skip this job.

This will only work if the sequence of the jobs remains the same (i.e. input is unchanged).

while(<LOG>) {
/^(\d+)/ || die;
# This is 30% faster than set_job_already_run($1);
vec($Global::job_already_run,$1,1) = 1;
}

if(is_job_already_run($seq)) {
# Skip
} else {
# Run it
}

sub set_job_already_run {
my $seq = shift;
vec($Global::job_already_run,$seq,1) = 1;
}

sub is_job_already_run {
my $seq = shift;
return vec($Global::job_already_run,$seq,1);
}

Ole Tange <tange>
Project AdministratorIn charge of this item.

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by tange (Submitted the item)
  • -unavailable- added by tange
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 3 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Sat 07 Jan 2012 03:31:50 AM UTCtangeStatusNone=>Fixed
      Open/ClosedOpen=>Closed
    Sun 18 Dec 2011 03:53:58 PM UTCtangeCarbon-Copy-=>Added -unavailable-

    Back to the top


    Powered by Savane 3.1-cleanup1