bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #45203, GNU Parallel stops processing...

 
 

bug #45203: GNU Parallel stops processing claiming bugid "swap_activity_file-r"

Submitted by:  Douglas A. Augusto <daaugusto>
Submitted on:  Thu 28 May 2015 02:41:00 PM UTC  
 
Category: NoneSeverity: 3 - Normal
Item Group: NoneStatus: Need Info
Privacy: PublicAssigned to: None
Open/Closed: Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Fri 26 Jun 2015 10:31:21 PM UTC, comment #2:

Open for 1 month waiting for info. Closing.

If you have new info, re-open bug.

Ole Tange <tange>
Project Administrator
Sun 07 Jun 2015 10:35:52 PM UTC, comment #1:

Thanks for your bug report. Please follow http://www.gnu.org/software/parallel/man.html#REPORTING-BUGS

(For one: You have not included run.sh, so it will be impossible for me to run your example).

Also you might want to take a look at --memfree.

Ole Tange <tange>
Project Administrator
Thu 28 May 2015 02:41:00 PM UTC, original submission:

Hi,

After processing tens of thousands (or even hundreds of thousands) of jobs, GNU Parallel crashes. This is the error message: "parallel: This should not happen. You have found a bug."

The version is 20150524, but this happened with releases from the past few months as well (if I recall correctly). The bugid is swap_activity_file-r

The command-line is as follows:

$ parallel --slf servers.slf --resume --retries 3 --noswap --wd optimization-fit --controlmaster --nice 10 --progress -j procfile --files --results ~/optimization-fit/results/RELAXED-1/out --joblog ~/optimization-fit/results/RELAXED-1/jobs.log --colsep ' ' ./run.sh {1} {2} {3} {4} {5} {6} :::: jobs.txt

Additional information:

$ cat servers.slf
:

(only the localhost)

$ cat procfile
100%

$ head ~/optimization-fit/results/RELAXED-1/jobs.log
Seq Host Starttime JobRuntime Send Receive Exitval Signal Command
40 : 1431822569.519 26.118 0 253 0 0 ./run.sh n4w3b1 040 055 4 0.60 0.05
35 : 1431822569.507 27.141 0 253 0 0 ./run.sh n4w3b1 040 055 4 0.60 0.20
38 : 1431822569.514 27.692 0 253 0 0 ./run.sh n4w3b1 040 055 4 0.60 0.50
29 : 1431822569.496 30.657 0 253 0 0 ./run.sh n4w3b1 040 055 4 0.80 0.05
25 : 1431822569.488 30.901 0 253 0 0 ./run.sh n4w3b1 040 055 4 0.80 0.15
27 : 1431822569.492 31.794 0 253 0 0 ./run.sh n4w3b1 040 055 4 0.80 0.50
26 : 1431822569.491 32.810 0 253 0 0 ./run.sh n4w3b1 040 055 4 0.80 0.40
31 : 1431822569.500 32.842 0 253 0 0 ./run.sh n4w3b1 040 055 4 0.80 0.30
28 : 1431822569.494 33.567 0 253 0 0 ./run.sh n4w3b1 040 055 4 0.80 0.45

$ head jobs.txt
n4w3b1 040 055 4 1.00 0.00
n4w3b1 040 055 4 1.00 0.20
n4w3b1 040 055 4 1.00 0.15
n4w3b1 040 055 4 1.00 0.40
n4w3b1 040 055 4 1.00 0.50
n4w3b1 040 055 4 1.00 0.45
n4w3b1 040 055 4 1.00 0.05
n4w3b1 040 055 4 1.00 0.10
n4w3b1 040 055 4 1.00 0.30
n4w3b1 040 055 4 1.00 0.35

$ uname -a
Linux gnu 3.14-2-amd64 #1 SMP Debian 3.14.15-2 (2014-08-09) x86_64 GNU/Linux

Douglas A. Augusto <daaugusto>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by tange (Posted a comment)
  • -unavailable- added by daaugusto (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Fri 26 Jun 2015 10:31:21 PM UTCtangeOpen/ClosedOpen=>Closed
    Sun 07 Jun 2015 10:35:52 PM UTCtangeStatusNone=>Need Info

    Back to the top


    Powered by Savane 3.1-cleanup1