BENCHMARKS.md

Systems

MacBook

macOS High Sierra 10.13.2 MacBook Pro (Retina, 13-inch, late 2013) 2.4 GHz Intel Core i5 6 GB 1600 MHz DDR3 250 GB SSD

Server

Ubuntu 16.04 Intel(R) Xeon(R) CPU E5-2660 v4 @ 2.00GHz 56 virtual cores 2 processors, 14 cores, hyperthreading enabled 500 GB Memory

Cluster

Supercomputer

Grid

Sofware details

CWL

Reference Runner Toil

Container technology

All containers are prebuild or fetched, so the performance benchmark exclude construction or fetching of containers (warm start).

Docker

Docker community edition

OSX: 17.09.1-ce-mac42 Linux: 17.12.0-ce

Singularity

Udocker

Distribution framework

Mesos Slurm

Results

server toil docker 170.59s user 43.20s system 106% cpu 3:20.88 total 150.49s user 40.19s system 97% cpu 3:15.76 total 173.92s user 44.58s system 104% cpu 3:29.88 total 131.21s user 37.82s system 81% cpu 3:26.39 total