bugGNU Parallel - Bugs: bug #66630, parallel_alternatives += concur

 
 

bug #66630: parallel_alternatives += concur

Submitter:  None
Submitted:  Fri 03 Jan 2025 11:06:10 AM UTC
   
 
Category:  None Severity:  3 - Normal
Priority:  5 - Normal Item Group:  None
Status:  None Privacy:  Public
Assigned to:  None Open/Closed:  Open
* Mandatory Fields

Post a Comment

Add a New Comment Rich Markup
   

Discussion

Fri 03 Jan 2025 11:06:10 AM UTC, original submission:  

https://github.co ... /ewosborne/concur

> It's got defaults that don't work for me (one job per core when I'm blocking on network I/O is hugely inefficient).


-j0

You can put it into ~/.parallel/config if you want it default.

> Its CLI is convoluted (yes, it's a hard problem to solve in general, but still).


Would be nice to know, what that really means. It is probably just the ':::' which seems to be the big hurdle.

> It's got a 120-page manual or a 20-minute training video to teach you how to use it.


Yep. Loads of documentation. Even a cheat sheet, too.

> It's written in Perl.


Yep. Works on even old systems where Go will never run.

> It has this weird thing where it can't do CSV right out of the box and you have to do manual CPAN stuff.


And that made sense once. But should probably be fixed: Having the goal of single-file-install in mind.

> concur "dig @{{1}} ocw.mit.edu" 1.1.1.1 9.9.9.9 8.8.8.8 94.140.14.14


parallel -j0 "dig @{1} ocw.mit.edu" ::: 1.1.1.1 9.9.9.9 8.8.8.8 94.140.14.14

> echo "foo bar baz" | concur "touch /tmp/{{1}}.foo"


By design GNU Parallel does not split on space, but \n

printf "%s\n" foo bar baz | parallel "touch /tmp/{1}.foo"

> concur "ping -c 1 {{1}}" www.mit.edu www.ucla.edu www.slashdot.org


parallel "ping -c 1 {1}" ::: www.mit.edu www.ucla.edu www.slashdot.org

> concur "ping -c 1 {{1}}" www.mit.edu www.ucla.edu www.slashdot.org | jq '.command[0]


parallel --results -.json "ping -c 1 {1}" ::: www.mit.edu www.ucla.edu www.slashdot.org | jq .Command

> --any


parallel --halt now,success=1

> --first


parallel --halt now,done=1

> -c N


parallel --jobs N

> ./concur "ping -c 1 {{1}}" www.mit.edu www.ucla.edu www.slashdot.ogr --flag-errors > /dev/null


Use --joblog:

parallel  --joblog my.log "ping -c 1 {1}" ::: www.mit.edu www.ucla.edu www.slashdot.ogr
cat my.log

> concur "scp -O rudder.zip {{1}}:" nas wamp-rat cloud --pbar


parallel --bar "scp -O rudder.zip {1}:" ::: nas wamp-rat cloud

> ./concur "ping -c 1 @@@" www.mit.edu www.ucla.edu www.slashdot.org --token @@@


parallel -I @@@ "ping -c 1 @@@" ::: www.mit.edu www.ucla.edu www.slashdot.org

> concur "do-something-to-image {{1}}" <...10,0000 image names> -j 10s -c 1x


parallel --timeout 10s "do-something-to-image {{1}}" ::: <...10,0000 image names>

> concur "do-something-to-image {{1}}" <...10,0000 image names> -t 2h -c 1x


timeout 7200 parallel "do-something-to-image {{1}}" ::: <...10,0000 image names>


Anonymous

 

Attached Files

This item currently has no attached files.

(Note: upload size limit is set to 4.0MiB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

 

Dependencies

This item does not depend on any other items.

No items depend on this one.

 

Mail Notification Carbon-Copy List

 

Votes

There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

Only logged-in users can vote.

 

History

No changes have been made to this item

Back to the top

Powered by Savane 3.16-11ef.
Corresponding source code