Summary
Distributed Computing
Debian Science Distributed Computing packages
This metapackage will install Debian Science packages useful for
various types of distributed computing, such as grid-, cloud-, cluster-
and parallel-computing.
Description
For a better overview of the project's availability as a Debian package, each head row has a color code according to this scheme:
If you discover a project which looks like a good candidate for Debian Science
to you, or if you have prepared an unofficial Debian package, please do not hesitate to
send a description of that project to the Debian Science mailing list
Links to other tasks
|
Debian Science Distributed Computing packages
Official Debian packages with high relevance
dmtcp
??? missing short description for package dmtcp :-(
|
Versions of package dmtcp |
Release | Version | Architectures |
jessie | 2.3.1-6 | amd64,armhf,i386 |
Debtags of package dmtcp: |
role | program |
|
License: DFSG free
|
Please cite:
Jason Ansel, Kapil Arya, and Gene Cooperman:
DMTCP: Transparent Checkpointing for Cluster Computations and the Desktop
(2009)
|
|
environment-modules
Modular system for handling environment variables
|
Versions of package environment-modules |
Release | Version | Architectures |
jessie | 3.2.10-9 | amd64,armel,armhf,i386 |
buster | 4.2.2-1 | amd64,arm64,armhf,i386 |
trixie | 5.5.0-1 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
bookworm | 5.2.0-1 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
sid | 5.5.0-1 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
stretch | 3.2.10-10 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
bullseye | 4.6.1-1 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
|
License: DFSG free
|
The Modules package provides for the dynamic modification of a user's
environment via modulefiles. Each modulefile contains the information
needed to configure the shell for an application. Once the Modules
package is initialized, the environment can be modified dynamically
on a per-module basis using the module command which interprets
modulefiles. Typically modulefiles instruct the module command to alter or
set shell environment variables such as PATH, MANPATH, etc. modulefiles
may be shared by many users on a system and users may have their own
collection to supplement or replace the shared modulefiles. The modules
environment is common on SGI/Crays and many workstation farms.
|
|
globus-core
??? missing short description for package globus-core :-(
|
Versions of package globus-core |
Release | Version | Architectures |
jessie | 9.0 | amd64,armel,armhf,i386 |
stretch | 9.1 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
|
License: DFSG free
|
|
|
gridengine-client
Utilities for Grid Engine queue management
|
Versions of package gridengine-client |
Release | Version | Architectures |
sid | 8.1.9+dfsg-11.1 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
bookworm | 8.1.9+dfsg-10 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
stretch | 8.1.9+dfsg-4+deb9u2 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
buster | 8.1.9+dfsg-9 | amd64,arm64,armhf,i386 |
bullseye | 8.1.9+dfsg-9.1 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
Debtags of package gridengine-client: |
role | program |
|
License: DFSG free
|
Grid Engine is software that facilitates "distributed resource
management" (DRM). Far more than just simple load-balancing tools or
batch scheduling mechanisms, DRM software typically provides the
following key features across large sets of distributed resources:
- Policy based allocation of distributed resources (CPU time,
software licenses, etc.)
- Batch queuing & scheduling
- Support diverse server hardware, OS and architectures
- Load balancing & remote job execution
- Detailed job accounting statistics
- Fine-grained user specifiable resources
- Suspend/resume/migrate jobs
- Tools for reporting Job/Host/Cluster status
- Job Arrays
- Integration & control of parallel jobs
This package contains the Grid Engine user utilities.
|
|
gridengine-exec
Distributed resource management - Execution Server
|
Versions of package gridengine-exec |
Release | Version | Architectures |
sid | 8.1.9+dfsg-11.1 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
buster | 8.1.9+dfsg-9 | amd64,arm64,armhf,i386 |
stretch | 8.1.9+dfsg-4+deb9u2 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
bookworm | 8.1.9+dfsg-10 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
bullseye | 8.1.9+dfsg-9.1 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
Debtags of package gridengine-exec: |
role | program |
|
License: DFSG free
|
Grid Engine is software that facilitates "distributed resource
management" (DRM). Far more than just simple load-balancing tools or
batch scheduling mechanisms, DRM software typically provides the
following key features across large sets of distributed resources:
- Policy based allocation of distributed resources (CPU time,
software licenses, etc.)
- Batch queuing & scheduling
- Support diverse server hardware, OS and architectures
- Load balancing & remote job execution
- Detailed job accounting statistics
- Fine-grained user specifiable resources
- Suspend/resume/migrate jobs
- Tools for reporting Job/Host/Cluster status
- Job Arrays
- Integration & control of parallel jobs
This package contains the Grid Engine execution server.
|
|
gridengine-master
Distributed resource management - Master Server
|
Versions of package gridengine-master |
Release | Version | Architectures |
stretch | 8.1.9+dfsg-4+deb9u2 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
buster | 8.1.9+dfsg-9 | amd64,arm64,armhf,i386 |
sid | 8.1.9+dfsg-11.1 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
bookworm | 8.1.9+dfsg-10 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
bullseye | 8.1.9+dfsg-9.1 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
|
License: DFSG free
|
Grid Engine is software that facilitates "distributed resource
management" (DRM). Far more than just simple load-balancing tools or
batch scheduling mechanisms, DRM software typically provides the
following key features across large sets of distributed resources:
- Policy based allocation of distributed resources (CPU time,
software licenses, etc.)
- Batch queuing & scheduling
- Support diverse server hardware, OS and architectures
- Load balancing & remote job execution
- Detailed job accounting statistics
- Fine-grained user specifiable resources
- Suspend/resume/migrate jobs
- Tools for reporting Job/Host/Cluster status
- Job Arrays
- Integration & control of parallel jobs
This package contains the Grid Engine master server.
|
|
gridengine-qmon
Graphical utilities for Grid Engine queue management
|
Versions of package gridengine-qmon |
Release | Version | Architectures |
buster | 8.1.9+dfsg-9 | amd64,arm64,armhf,i386 |
sid | 8.1.9+dfsg-11.1 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
bookworm | 8.1.9+dfsg-10 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
bullseye | 8.1.9+dfsg-9.1 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
stretch | 8.1.9+dfsg-4+deb9u2 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
Debtags of package gridengine-qmon: |
uitoolkit | motif |
|
License: DFSG free
|
Grid Engine is software that facilitates "distributed resource
management" (DRM). Far more than just simple load-balancing tools or
batch scheduling mechanisms, DRM software typically provides the
following key features across large sets of distributed resources:
- Policy based allocation of distributed resources (CPU time,
software licenses, etc.)
- Batch queuing & scheduling
- Support diverse server hardware, OS and architectures
- Load balancing & remote job execution
- Detailed job accounting statistics
- Fine-grained user specifiable resources
- Suspend/resume/migrate jobs
- Tools for reporting Job/Host/Cluster status
- Job Arrays
- Integration & control of parallel jobs
This package contains the graphical Grid Engine administration frontend.
|
|
htcondor
transitional dummy package
|
Versions of package htcondor |
Release | Version | Architectures |
trixie | 23.6.2+dfsg-2 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
jessie | 8.2.3~dfsg.1-6 | amd64,armel,armhf,i386 |
stretch | 8.4.11~dfsg.1-1 | amd64,arm64,armel,armhf,i386,mips,mipsel,ppc64el,s390x |
stretch-security | 8.4.11~dfsg.1-1+deb9u2 | amd64,arm64,armel,armhf,i386 |
buster | 8.6.8~dfsg.1-2+deb10u1 | amd64,arm64,armhf,i386 |
sid | 23.6.2+dfsg-2 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
buster-security | 8.6.8~dfsg.1-2+deb10u1 | amd64,arm64,armhf,i386 |
upstream | 24.2.2 |
|
License: DFSG free
|
This package aids upgrades of existing htcondor installations to the
package name "condor". The package is empty and it can safely be removed.
Please cite:
Michael Litzkow, Miron Livny and Matt Mutka:
Condor - A Hunter of Idle Workstations
(eprint)
Proceedings of the 8th International Conference of Distributed Computing Systems
:104-111
(1988)
|
|
ipython3
Enhanced interactive Python 3 shell
|
Versions of package ipython3 |
Release | Version | Architectures |
bullseye | 7.20.0-1+deb11u1 | all |
jessie | 2.3.0-2 | all |
stretch | 5.1.0-3 | all |
stretch-security | 5.1.0-3+deb9u1 | all |
buster | 5.8.0-1+deb10u1 | all |
buster-security | 5.8.0-1+deb10u1 | all |
bullseye-security | 7.20.0-1+deb11u1 | all |
bookworm | 8.5.0-4 | all |
trixie | 8.29.0-1 | all |
sid | 8.30.0-1 | all |
|
License: DFSG free
|
IPython can be used as a replacement for the standard Python shell,
or it can be used as a complete working environment for scientific
computing (like Matlab or Mathematica) when paired with the standard
Python scientific and numerical tools. It supports dynamic object
introspections, numbered input/output prompts, a macro system,
session logging, session restoring, complete system shell access,
verbose and colored traceback reports, auto-parentheses, auto-quoting,
and is embeddable in other Python programs.
This package contains the actual terminal shell for Python 3.
|
|
mpich
Implementation of the MPI Message Passing Interface standard
|
Versions of package mpich |
Release | Version | Architectures |
bullseye | 3.4.1-5~deb11u1 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
buster | 3.3-3 | amd64,arm64,armhf,i386 |
stretch | 3.2-7 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
jessie | 3.1-5 | amd64,armel,armhf,i386 |
experimental | 4.2.1-3 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
sid | 4.2.1-2 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
trixie | 4.2.0-14 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
bookworm | 4.0.2-3 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
upstream | 4.2.3 |
Debtags of package mpich: |
admin | benchmarking, monitoring |
network | hiavailability, load-balancing, scanner |
scope | utility |
use | transmission |
|
License: DFSG free
|
MPICH is a high-performance and widely portable implementation of the
MPI-3.1 standard from the Argonne National Laboratory.
It efficiently supports different computation and communication platforms
including commodity clusters, SMPs, massively parallel systems, and
high-speed networks.
This release has all MPI 3.1 functions and features required by the standard
with the exception of support for the "external32" portable I/O format and
user-defined data representations for I/O.
This package includes the program binaries necessary to run MPICH programs.
|
|
mpich2python
??? missing short description for package mpich2python :-(
|
Versions of package mpich2python |
Release | Version | Architectures |
jessie | 2.9.4-3 | amd64,armel,armhf,i386 |
|
License: DFSG free
|
|
|
nordugrid-arc-client
|
Versions of package nordugrid-arc-client |
Release | Version | Architectures |
jessie | 4.2.0-2 | amd64,armel,armhf,i386 |
stretch | 5.3.0~rc1-1 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
buster | 5.4.3-2 | amd64,arm64,armhf,i386 |
bullseye | 6.10.2-1 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
sid | 6.21.0-1 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
trixie | 6.21.0-1 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
bookworm | 6.17.0-3 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
|
License: DFSG free
|
NorduGrid is a collaboration aiming at development, maintenance and
support of the middleware, known as the Advanced Resource
Connector (ARC).
This client package contains all the CLI tools that are needed to
operate with x509 proxies, submit and manage jobs and handle data
transfers.
|
|
openmpi-bin
high performance message passing library -- binaries
|
Versions of package openmpi-bin |
Release | Version | Architectures |
jessie | 1.6.5-9.1+deb8u1 | amd64,armel,armhf,i386 |
sid | 5.0.6-3 | amd64,arm64,mips64el,ppc64el,riscv64,s390x |
trixie | 5.0.6-3 | amd64,arm64,mips64el,ppc64el,riscv64,s390x |
bookworm | 4.1.4-3 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
bullseye | 4.1.0-10 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
buster | 3.1.3-11 | amd64,arm64,armhf,i386 |
stretch | 2.0.2-2 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
Debtags of package openmpi-bin: |
admin | cluster |
field | biology, chemistry, mathematics, physics |
interface | commandline |
role | program |
scope | utility |
|
License: DFSG free
|
Open MPI is a project combining technologies and resources from several other
projects (FT-MPI, LA-MPI, LAM/MPI, and PACX-MPI) in order to build the best
MPI library available. A completely new MPI-3.1 compliant implementation, Open
MPI offers advantages for system and software vendors, application developers
and computer science researchers.
Features:
- Full MPI-3.1 standards conformance
- Thread safety and concurrency
- Dynamic process spawning
- High performance on all platforms
- Reliable and fast job management
- Network and process fault tolerance
- Support network heterogeneity
- Single library supports all networks
- Run-time instrumentation
- Many job schedulers supported
- Internationalized error messages
- Component-based design, documented APIs
This package contains the Open MPI utility programs.
|
|
openmpipython
??? missing short description for package openmpipython :-(
|
Versions of package openmpipython |
Release | Version | Architectures |
jessie | 2.9.4-3 | amd64,armel,armhf,i386 |
|
License: DFSG free
|
|
|
python3-scoop
Python3 library for concurrent parallel programming
|
Versions of package python3-scoop |
Release | Version | Architectures |
bullseye | 0.7.1.1-7 | all |
buster | 0.7.1.1-3 | all |
stretch | 0.7.1.1-1 | all |
|
License: DFSG free
|
SCOOP (Scalable COncurrent Operations in Python) is a distributed task
module allowing concurrent parallel programming on various environments,
from heterogeneous grids to supercomputers.
This package contains the Python3 modules.
|
|
Official Debian packages with lower relevance
coop-computing-tools
cooperative computing tools
|
Versions of package coop-computing-tools |
Release | Version | Architectures |
sid | 9.9-4.1 | armel,armhf |
stretch | 4.0-1.1 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
sid | 7.13.1-2 | amd64,arm64,i386,mips64el,ppc64el,riscv64,s390x |
bookworm | 9.9-2 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
bullseye | 7.1.2-5 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
buster | 7.0.9-2 | amd64,arm64,armhf,i386 |
Debtags of package coop-computing-tools: |
uitoolkit | ncurses |
|
License: DFSG free
|
This is a collection of software that help users to share resources in a
complex, heterogeneous, and unreliable computing environment. This includes:
- Chirp: A personal filesystem and I/O protocol that allows unprivileged users
to share space securely, efficiently, and conveniently. When combined
with Parrot, Chirp allows users to create custom wide-area
distributed filesystems.
- Parrot: A transparent user-level virtual filesystem that allows any ordinary
program to be attached to a remote storage device such as an FTP
server or a Chirp server.
- Makeflow: A workflow system for parallel and distributed computing that uses
a language very similar to Make.
- Work Queue: A system and API for building master-worker style programs that
scale up to thousands of processors.
- All Pairs: A computational abstraction for running very large Cartesian
products.
- Wavefront: A computational abstraction for running very large dynamic
programming problems.
- The Fault Tolerant Shell: A high-level programming language that allows
users to combine the ease of shell scripting, the power of distributed
programming, and the precision of compiled languages. Basically,
parallel programming and exception handling for scripts.
|
|
hpcc
|
Versions of package hpcc |
Release | Version | Architectures |
sid | 1.5.0-4 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
trixie | 1.5.0-4 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
stretch | 1.4.3-1 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
bookworm | 1.5.0-3 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
buster | 1.5.0-1 | amd64,arm64,armhf,i386 |
jessie | 1.4.1-3 | amd64,armel,armhf,i386 |
Debtags of package hpcc: |
admin | benchmarking |
role | program |
|
License: DFSG free
|
The High Performance Computing (HPC) Challenge benchmark runs a suite
of 7 tests that measure the performance of CPU, memory and network for
HPC clusters. Amongst others, it includes the High-Performance LINPACK
(HPL) benchmark, used by the Top500 ranking (http://www.top500.org/).
|
|
python3-mpi4py
bindings of the Message Passing Interface (MPI) standard
|
Versions of package python3-mpi4py |
Release | Version | Architectures |
jessie | 1.3.1+hg20131106-2 | amd64,armel,armhf,i386 |
bookworm | 3.1.4-2 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
bullseye | 3.0.3-8 | amd64,arm64,armel,armhf,i386,mips64el,mipsel,ppc64el,s390x |
trixie | 4.0.1-6 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
sid | 4.0.1-6 | amd64,arm64,armel,armhf,i386,mips64el,ppc64el,riscv64,s390x |
experimental | 4.0.1-6.exp1 | amd64,arm64,mips64el,ppc64el,riscv64 |
buster | 2.0.0-3 | amd64,arm64,armhf,i386 |
stretch | 2.0.0-2.1+deb9u1 | amd64,arm64,armel,armhf,i386,mips,mips64el,mipsel,ppc64el,s390x |
|
License: DFSG free
|
MPI for Python (mpi4py) provides bindings of the Message Passing
Interface (MPI) standard for the Python programming language,
allowing any Python program to exploit multiple processors.
mpi4py is constructed on top of the MPI-1/MPI-2 specification
and provides an object oriented interface which closely follows MPI-2
C++ bindings. It supports point-to-point (sends, receives) and
collective (broadcasts, scatters, gathers) communications of any
picklable Python object as well as optimized communications of Python
object exposing the single-segment buffer interface (NumPy arrays,
builtin bytes/string/array objects).
|
|
No known packages available
psom
pipeline system for Octave and Matlab
|
|
License: MIT/Expat
Debian package not available
Language: Matlab/Octave
|
PSOM is a lightweight library to manage complex multi-stage data processing. A
pipeline is a collection of jobs, i.e. Matlab or Octave code with a well
identified set of options that are using files for inputs and outputs. To
use PSOM, the only requirement is to generate a description of a pipeline in
the form of a simple Matlab/Octave structure. PSOM then automatically offers
the following services:
- Run jobs in parallel using multiple CPUs or within a distributed computing
environment.
- Generate log files and keep track of the pipeline execution. These logs are
detailed enough to fully reproduce the analysis.
- Handle job failures: successful completion of jobs is checked and failed
jobs can be restarted.
- Handle updates of the pipeline: change options or add jobs and let PSOM
figure out what to reprocess.
|
|