GNU Parallel - Summary
This software is part of the GNU Project.
NAME
parallel - build and execute shell command lines from standard input in parallel
DESCRIPTION
GNU parallel is a shell tool for executing jobs concurrently locally or using remote computers. A job is typically a single command or a small script that has to be run for each of the lines in the input. The typical input is a list of files, a list of hosts, a list of users, a list of URLs, or a list of tables.
If you use xargs today you will find GNU parallel very easy to use as GNU parallel is written to have the same options as xargs. If you write loops in shell, you will find GNU parallel may be able to replace most of the loops and make them run faster by running several jobs simultaneously.
GNU parallel makes sure output from the commands is the same output as you would get had you run the commands sequentially. This makes it possible to use output from GNU parallel as input for other programs.
For each line of input GNU parallel will execute command with the line as arguments. If no command is given, the line of input is executed. Several lines will be run in parallel. GNU parallel can often be used as a substitute for xargs or cat | bash.
Before looking at the options you may want to check out the examples after the list of options. That will give you an idea of what GNU parallel is capable of.
EXAMPLES
You may want to watch the intro video for a quick introduction: http://www.youtube.com/watch?v=OpaiGYxkSuQ
Go through the tutorial http://www.gnu.org/software/parallel/parallel_tutorial.html or
see the man page or https://www.gnu.org/software/parallel/man.html#EXAMPLE:-Working-as-xargs--n1.-Argument-appending
for more examples.
Registration Date: Mon 27 Aug 2007 02:16:53 PM UTC
License: GNU General Public License v3 or later
Development Status: 5 - Production/Stable
posted by tange, Mon 23 Sep 2024 08:49:16 PM UTC
GNU Parallel 20240922 ('Gold Apollo AR924') has been released. It is available for download at: lbry://@GnuParallel:4
Quote of the month:
Recently executed a flawless live data migration of ~2.4pb using GNU parallel for scale and bash scripts.
[...]
posted by tange, Wed 21 Aug 2024 08:09:13 PM UTC
GNU Parallel 20240822 ('Southport') has been released. It is available for download at: lbry://@GnuParallel:4
Quote of the month:
honestly the coolest software i've ever seen gotta be gnu parallel or
ffmpeg, nothing like them
[...]
posted by tange, Sun 21 Jul 2024 03:01:50 AM UTC
GNU Parallel 20240722 ('Assange') has been released. It is available for download at: lbry://@GnuParallel:4
Quote of the month:
parallel is frickin great for launching jobs on multiple
machines. Ansible and Jenkins and others may be good too but I was
[...]
posted by tange, Mon 24 Jun 2024 07:00:25 PM UTC
GNU Parallel 20240622 ('34 counts') has been released. It is available for download at: lbry://@GnuParallel:4
Quote of the month:
The most glorious 15,000 lines of Perl ever written.
-- @nibblrrr7124@YouTube
New in this release:
[...]
Powered by Savane 3.13-8ccc.
Corresponding source code