GNU Parallel - News
GNU Parallel 20101113 released
Item posted by Ole Tange <tange> on Sat 13 Nov 2010 03:41:27 PM UTC.
GNU Parallel 20101113 has been released. It is available for download at: http://ftp.gnu.org/gnu/parallel/
New in this release:
- Using -j myfile the number of jobs can be changed while GNU Parallel is running simply by changing the content of myfile.
- Implemented --profile to use different .parallel/config for different situations.
- Ugly newlines in $PARALLEL and .parallel/config are no longer needed. Instead you have to use \ in front of special shell characters.
- --workdir puts the files transferred to remote machines in a specified directory.
- $PARALLEL_PID is set to the process id of GNU Parallel.
- $PARALLEL_SEQ is set to the sequence number of the job.
- -v now only shows the command to run. Use -v -v to show the ssh/rsync wrapping.
- Slow spawning error is now only a warning.
- If stdin is a tty and input is read from stdin you now get a warning.
- GNU sql: \n and \x0a in arguments is replaced with newline.
- Patch for Debian package and spelling mistakes. Thanks to Rogério Brito <rbrito at ime dot usp dot br>
- Mac OS X Homebrew package. Thanks to Jonathan Palardy <jonathan dot palardy at gmail dot com>
- FreeBSD port. Thanks to Chris Howey <howeyc at gmail dot com>
- Pardus package. Thanks to Fethican Coşkuner <fethicanc at gmail dot com>
- First review in Chinese. Thanks to 曾義峰: http://antbsd.twbbs.org/~ant/wordpress/?p=2876
- First review in print: http://www.linux-magazine.com/Issues/2010 Nov 2010
- First review in Spanish: http://www.muylinux.com/2010/10/18/gnu-parallel-computacion-paralela-a-golpe-de-comando
- First review in Dutch thanks to Koen Vervloesem <koen at vervloesem dot eu>: http://techworld.nl/technologie/33493/gebruik-al-je-processorkernen-met-gnu-parallel.html
- Blog review thanks to R. Tyler Croy <tyler at monkeypox dot org>: http://unethicalblogger.com/posts/2010/11/gnuparallel_changed_my_life
- 5000 views of the intro video: http://www.youtube.com/watch?v=OpaiGYxkSuQ
- As usual a bunch of bugfixes and more usage examples in the man page.
- GNU Parallel was presented at FSCONS 2010-11-07: http://www.fscons.org/fs/gnu-parallel Hopefully the video will be online soon.
About GNU Parallel
GNU Parallel is a shell tool for executing jobs in parallel using one or more machines. A job is typically a single command or a small script that has to be run for each of the lines in the input. The typical input is a list of files, a list of hosts, a list of users, a list of URLs, or a list of tables.
If you use xargs today you will find GNU Parallel very easy to use as GNU Parallel is written to have the same options as xargs. If you write loops in shell, you will find GNU Parallel may be able to replace most of the loops and make them run faster by running several jobs in parallel. If you use ppss or
pexec you will find GNU Parallel will often make the command easier to read.
GNU Parallel makes sure output from the commands is the same output as you would get had you run the commands sequentially. This makes it possible to use output from GNU Parallel as input for other programs.
You can find more about GNU Parallel at: http://www.gnu.org/software/parallel/
Watch the intro video on http://www.youtube.com/watch?v=OpaiGYxkSuQ or at http://tinyogg.com/watch/TORaR/ and http://tinyogg.com/watch/hfxKj/
Powered by Savane 3.14-8aba.
Corresponding source code