The same storage system that gave us problems on Wednesday hung again Friday evening. This time we did not lose any nodes. We know what is causing the issue now and are working with the vendor on a software fix. Running jobs had time added to compensate for the hang. Last Updated Friday, Jan 17 06:50 pm 2020

Computing Resources

  • The Office of Research Computing offers a total of 23,920 CPU cores and over 90 TB of memory across 1,012 compute nodes.
  • Compute resources are supported by approximately 6 petabytes of storage.
  • All nodes run Red Hat Enterprise Linux 7.6.
Login nodes:
Hostname Accessibility Nodes Cores/Node CPU Type Memory/Node Memory Speed
ssh.rc.byu.edu anywhere 4 40 20-core Intel Cascade Lake (2.1 GHz) 768 GB 2933 MT/s DDR4

Compute nodes:
Cluster Nodes Total Cores Total Memory Cores/Node CPU Type Memory/Node Memory Speed Walltime Limit Infiniband GPUs/Node
marylou9g 40 1120 5120 GB 28 14-core Intel Broadwell (2.4 GHz) 128 GB 2400 MHz DDR4 3 days 100 Gb/s Omnipath 4 x P100 GPUs
marylou9 256 7168 32768 GB 28 14-core Intel Broadwell (2.4 GHz) 128 GB 2400 MHz DDR4 3 days 4X FDR
marylou8 (64 GB) 240 5760 15360 GB 24 12-core Intel Haswell (2.3 GHz) 64 GB 2133 MHz DDR4 7 days
marylou8 (128 GB) 80 1920 10240 GB 24 12-core Intel Haswell (2.3 GHz) 128 GB 2133 MHz DDR4 7 days
marylou8f (256 GB) 8 192 2048 GB 24 12-core Intel Haswell (2.6 GHz) 256 GB 2133 MHz DDR4 3 days
marylou8f (512 GB) 1 24 512 GB 24 12-core Intel Haswell (2.6 GHz) 512 GB 2133 MHz DDR4 3 days
marylou8g 32 768 2048 GB 24 12-core Intel Haswell (2.3 GHz) 64 GB 2133 MHz DDR4 3 days 4X FDR 4 x Nvidia GK210 GPUs
(2 x K80 cards w/2 GPUs each)
marylou7 (64 GB) 128 2048 8192 GB 16 8-core Intel Sandy Bridge (2.2 GHz) 64 GB 1600 MHz DDR3 3 days 4X QDR
marylou7 (32 GB) 192 3072 6144 GB 16 8-core Intel Sandy Bridge (2.2 GHz) 32 GB 1600 MHz DDR3 3 days 4X QDR
Preemption only (request with "-C knl --qos=standby") 18 1296 3456 GB 72 72-core Intel Xeon Phi 7290-F (aka "KNL") (1.50 GHz) 192 GB 2400 MHz DDR4
Preemption only 2 160 3072 GB 80 20-core Intel Skylake Xeon Gold 6148 (2.4 GHz) 1536 GB 2666 MHz DDR4
Preemption only 10 240 640 GB 24 12-core Intel Haswell (2.3 GHz) 64 GB 2133 MHz DDR4 4X FDR
Preemption only 4 128 2048 GB 32 16-core Intel Broadwell (2.1 GHz) 512 GB 2400 MHz DDR4
Preemption only 1 24 512 GB 24 12-core Intel Haswell (2.6 GHz) 512 GB 2133 MHz DDR4
Total 1012 23920 92160 GB