paexec An utility that distributes given tasks (stdin) across several CPUs or machines in a network.
Download

paexec Ranking & Summary

paexec Tags

tasks network distribute distribute tasks network cluster

paexec Description

An utility that distributes given tasks (stdin) across several CPUs or machines in a network. paexec is an utility that distributes given tasks (stdin) across several CPUs or machines in a network.paexec has no limited internal buffers anymore. All they are resized automatically as it is needed. PAEXEC_BUFSIZE environment variable sets an *initial* buffer size, not *maximum* one.README: notes about non-standard function getopt_long, and advice how to build paexec on platforms with no getopt_long support (JP-UX, Solaris etc.).Installation:0) BSD make is required. I name it 'bmake' but its real name may vary. pmake or just make are possible variants. If you need to change the default building options, run bmake like this env bmake See example section below1) "libmaa" library is required to build paexec. It is a part of "dict" project Quick sample of building: gzip -dc /home/cheusov/downloads/dictd-X.Y.Z.tar.gz | tar -xf- cd dictd-X-Y-Z/libmaa ./configure gmake gmake install NOTE: gmake is GNU make here! Under most Linux distros it is named make.2) Uncompress paexec tarball you've downloaded like this gzip -dc paexec-X-Y-Z.tar.gz | tar -xf-3) cd paexec-X-Y-Z4) bmake5) (optional!) bmake install-dirs6) bmake installThere are a lot of Makefile variables that can be changed duringbuilding and installation.paexec's own variables (All they are at the begining of Makefile): PREFIX - where paexec is installed to LIBMAA - linker option for linking "maa" libraryBSD make's variables (most commonly used,for all others - see make's documentation and .mk files) BINDIR - where paexec executable itself is installed to MANDIR - where manual pages are installed to BINOWN - paexec executable owner BINGRP - paexec executable group MANOWN - man page owner MANGRP - man page groupExamples of building and installing: 1) bmake all install-dirs install 2) env CC=icc PREFIX=/home/cheusov/local CPPFLAGS='-I/usr/pkg/include' LDFLAGS='-L/usr/pkg/lib -Wl,-rpath -Wl,/usr/pkg/lib' LDADD=-lextralib CFLAGS='-Werror -Wall' BINOWN=cheusov BINGRP=users MANOWN=cheusov MANGRP=users MKCATPAGES=no bmake -s all install-dirs install 3) paexec needs the non-portable getopt_long(3) present in *BSD and Linux OSes. If it is absent in your OS, you can build paexec like the following. echo '#include ' > ./config.h env CPPFLAGS='-DNO_PORTABHACKS_H=1 -DHAVE_CONFIG_H=1' LDFLAGS='-lnbcompat' bmake -s all install-dirs install where libnbcompat is a NetBSD's portability library Of course, you can also use any other implementation of getopt_long. NOTE: No, I'll not use autotools What's New in This Release: · The algorithm for cycle detection (paexec -s) was completely reworked and now does't allocate tasks_count^2 integers. · Now it works much faster. · The -Z _timeout_ option was added. · An attempt to rerun a command on a failed node is made every _timeout_ seconds. · This option makes it possible to organize clusters over unreliable networks, hardware or software.

paexec Related Software