Document Actions
CARC Systems
CARC supercomputers and clusters
Computational Resources at a Glance
Overview of computational resources at the Center, including OS, libraries, schedulers, etc.
Community Machines
The CARC houses a total of about 5 Tflops/sec (peak) of computing power and just under 100 TB of storage, distributed across various systems that include those of the resident research groups. Of this storage, 23 TB are accessible to the general research community. These latter data spaces are backed by an in-house developed Amanda-based system featuring 30 TB of LTO tape storage rotated through a 15 TB robotic tape library system (tapes not in the robot are stored off-site.) Major supercomputer resources in the CARC are shown in Table 1.
Also available on a limited basis to CARC researchers is access to the computational assets of the recently-established state-wide supercomputing center, the New Mexico Computing Applications Center. The NMCAC is managed by a consortium of the three New Mexico research universities (UNM, New Mexico Tech, NMSU), Los Alamos National Laboratory and Sandia National Laboratories.
The CARC-resident ARTS Lab maintains a 15 foot diameter SkySkan Dome Theater display system with six projectors and five-channel audio, switchable between an 8-node dual-CPU Windows-based rendering farm (with 10 TB of dedicated RAID storage) and an 16-core 32 GB RAM Mac Pro real-time rendering engine with advanced Nvidia graphics capabilities.
Name | ||||||||||||
Model & Type | Linux cluster SGI Altix ICE | Linux cluster Dell PowerEdge 1950 | Linux cluster IBM JS20 Blade Server | Shared Memory Multi-Processor IBM p5 570 | Shared Memory Multi-Processor IBM p5 550 | Apple cluster Apple Xserve G5 | ||||||
| OS | Linux | Linux | Linux | AIX | AIX | MacOS X | ||||||
| GFlops | 2100 | 1300 | 1200 | 61 | 12 | 256 | ||||||
Number of Nodes or Blades | 1 | 22 | 1 | 36 | 1 | 95 | 1 | 1 | 15 | 8 | ||
CPUs/Node | 2 | 2 | 2 | 2 | 2 | 2 | 4 | 2 | 2 | 1 | ||
| Cores/CPU | 4 | 4 | 2 | 2 | 1 | 1 | 2 | 1 | 1 | 2 | ||
| CPU Model | PowerPC 970 | PowerPC 970 | PowerPC Power5 | PowerPC G5 | PowerPC G5 | Pentium D Presler | ||||||
| Clock Speed | 2.66 GHz | 3.0 GHz | 2.33 GHz | 2.33 GHz | 1.6 GHz | 1.6 GHz | 1.5 GHz | 2 GHz | 2 GHz | 3.0 GHz | ||
| CPU L2 Cache (per CPU) | 2 x 4 MB | 2 x 4 MB | 4 MB | 4 MB | 512 KB | 512 KB | 1.9 MB | 512 KB | 512 KB | 2 x 2 MB | ||
| RAM/node | 8 GB | 16 GB | 8 GB | 8 GB | 4 GB | 4 GB | 7.6 GB | 2 GB | 2 GB | 2 GB | ||
| Local File Systems | 250 GB | 0 GB | 80 GB | 80 GB | 40 GB | 40 GB | 75 GB | 580 GB | 80 GB | 160 GB | ||
| Shared File Systems (NFS) | 11 TB | 6.6 TB | 400 GB | 1.8 TB | 1.8 TB | 500 GB | ||||||
| Interconnect | InfiniBand | Myrinet | Myrinet | |||||||||
| Network | InfiniBand | Gigabit Ethernet | Gigabit Ethernet | Fast Ethernet | Fast Ethernet | Gigabit Ethernet | ||||||
| Compilers | Intel C, C++, Fortran 95 PGI C, C++, Fortran 95, Fortran 77 GNU C, C++, Gfortran, Fortran 77 | PGI C, C++, Fortran 95, Fortran 77 GNU C, C++, Gfortran, Fortran 77 | IBM XLF, XLC GNU C, C++, Fortran 77 | IBM XLF, XLC GNU C, C++, Fortran 77 | IBM XLF, XLC
GNU C, C++, Fortran 77 | IBM XLF
GNU C, C++, Fortran 77 | ||||||
| Communication Libraries | MVAPICH | MPICH-GM MPICH-P4 | MPICH-GM MPICH-P4 | POE | POE | OpenMPI MPICH-P4 | ||||||
| Numerical Libraries | Intel MKL, BLACS | Goto BLAS, ATLAS, LAPACK, FFTW, BLACS, ScaLAPACK | ESSL, PESSL, Goto BLAS, LAPACK, FFTW, PIM, BLACS, ScaLAPACK | ESSL, PESSL, Goto BLAS, ATLAS, LAPACK, FFTW, BLACS | ESSL, PESSL, ATLAS, LAPACK, FFTW, BLACS | Accelerate Framework, Goto BLAS, ATLAS, LAPACK, FFTW, PIM | ||||||
| Batch Manager | Torque | Torque | Torque | Torque | Torque | |||||||
| Batch Scheduler | Maui | Maui | Maui | Torque | Torque | |||||||