There is a newer version of daskDask provides multi-core execution on larger-than-memory datasets using blocked algorithms and task scheduling.
Accessing dask 2022.10.0-foss-2022a
To load the module for dask 2022.10.0-foss-2022a please use this command on the BEAR systems (BlueBEAR, BEARCloud VMs, and CaStLeS VMs):
module load bear-apps/2022a
module load dask/2022.10.0-foss-2022a
BEAR Apps Version
EL8-cascadelake — EL8-haswell — EL8-icelake
The listed architectures consist of two part: OS-CPU.
- BlueBEAR: The OS used on BlueBEAR is represented by EL and there are several different processor (CPU) types available on BlueBEAR. More information about the processor types on BlueBEAR is available on the BlueBEAR Job Submission page.
- BEAR and CaStLeS Cloud VMs: These VMs can have one of two OSes. Those with access to a BEAR Cloud or CaStLeS VM should check that the listed architectures for an application include the OS of VM being used. The VMs, irrespective of OS, will use the haswell CPU type.
- cloudpickle 2.2.0
- dask 2022.10.0
- distributed 2022.10.0
- docrep 0.3.2
- fsspec 2021.7.0
- HeapDict 1.0.1
- locket 1.0.0
- partd 1.3.0
- tblib 1.7.0
- toolz 0.12.0
- zict 2.2.0
For more information visit the dask website.
This version of dask has a direct dependency on: bokeh/2.4.3-foss-2022a foss/2022a Python/3.10.4-GCCcore-11.3.0 PyYAML/6.0-GCCcore-11.3.0 SciPy-bundle/2022.05-foss-2022a
These versions of dask are available on the BEAR systems (BlueBEAR, BEARCloud VMs, and CaStLeS VMs). These will be retained in accordance with our Applications Support and Retention Policy.
Last modified on 16th February 2023