Table of Contents
Cluster HPC
New HPC Bubble Cluster
If your use case has needs related to parallel computing, i.e. multinode-MPI or needs special computing resources such as Intel Manycore or NVIDIA GPUs, probably you may want to access the CNAF HPC cluster. The cluster is powerful enough (2.91 PFlop/s) to be placed at the 437th place in the top500 ranking (November 2025).
This cluster is accessible via the SluRM Workload Manager which will be introduced hereafter.
Please refer to https://confluence.infn.it/spaces/TD/pages/40665319/7+-+The+HPC+cluster for details, HPC account request and how to access.
OBSOLETE - OLD HPC CLUSTER DISMISSED
Cluster description
The CNAF HPC cluster is composed of 12 nodes, some of them equipped with one or more GPUs.
Available GPUs are NVIDIA Tesla K20, K40 and K1.
All nodes are equipped with 2 Intel CPUs, 8 physical cores each, HyperThread enabled, for a total of 32HT cores in a single node.
All nodes are infiniband interconnected.
The cluster is accessible via the LSF batch system.
Home directories (4TB) and a 60TB gfps storage area are shared among the nodes.
Instructions on how to access the cluster are available in the Using the cluster section.
Pre-installed software on all the nodes is listed in the Installed Software section.
The table summarises the status of the cluster.
| Nodename | CPU | N core | GPU | Xeon PHI | RAM (GB) | IB | LSF Status |
|---|---|---|---|---|---|---|---|
| hpc-200-06-01 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | 2 x TeslaK20m | No | 64 | 1xQDR | Closed Flood |
| hpc-200-06-02 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | 4 x GRID K1 | No | 64 | 1xQDR | Closed Flood |
| hpc-200-06-03 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | 1 x TeslaK20m 4 x GRID K1 | No | 64 | 1xQDR | Closed Broken |
| hpc-200-06-04 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | 2 x TeslaK20m | No | 64 | 1xQDR | Open |
| hpc-200-06-05 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | 2 x TeslaK40m | No | 128 | 1xQDR + 2xFDR | Open |
| hpc-200-06-06 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | 2 x TeslaK40m | No | 128 | 1xQDR + 2xFDR | Open |
| hpc-200-06-07 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | 2 x TeslaK40m | No | 128 | 1xQDR | Closed moved for HTcondor tests |
| hpc-200-06-08 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | 2 x TeslaK40m | No | 128 | 1xQDR | Closed Used by DeepProject |
| hpc-200-06-09 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 128 | 1xQDR | Open |
| hpc-200-06-11 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-13-a | 2xIntel(R)X5650v2 @2.67GHz | 24HT | No | No | 48 | 1xQDR | Open |
| hpc-200-06-13-b | 2xIntel(R)X5650v2 @2.67GHz | 24HT | No | No | 48 | 1xQDR | Open |
| hpc-200-06-14 | 2xIntel(R)E5-2620v2 @2.00GHz | 24HT | No | 2 x Xeon Phi 5100 | 48 | 1xQDR | Open |
| hpc-200-06-15 | 2xIntel(R)E5-2620v2 @2.00GHz | 24HT | No | 1 x Xeon Phi 3120 | 48 | 1xQDR | Open |
| hpc-200-06-16 | 2xIntel(R)E5-2640v2 @2.00GHz | 24HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-17 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-18 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-19 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 64 | 1xQDR | Closed Broken |
| hpc-200-06-20 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 128 | 1xQDR | Open |
| hpc-200-06-21 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-22 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-23 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-24 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-25 | 2xIntel(R)E5-2640v2 @2.00GHz | 32HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-26 | 2xIntel(R)E5-2683v3 @2.00GHz | 56HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-27 | 2xIntel(R)E5-2683v3 @2.00GHz | 56HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-28 | 2xIntel(R)E5-2683v3 @2.00GHz | 56HT | No | No | 64 | 1xQDR | Open |
| hpc-200-06-29 | 2xIntel(R)E5-2683v3 @2.00GHz | 56HT | No | No | 64 | 1xQDR | Closed Internal Use |
| hpc-201-11-40 | 2xIntel(R)Gold6148 @2.40GHz | 80HT | 4 x Tesla-V100 SXM2 | No | 192 | 1xOPA | Open |
Getting Support
Information and Support can be asked to: hpc-support <_at_> lists.cnaf.infn.it