Supercomputer for Astronomy “ATERUI” Upgraded to Double its Speed.

Nov 13, 2014

【Abstract】

The Center for Computational Astrophysics (CfCA) of the National Astronomical Observatory of Japan upgraded the supercomputer Cray XC30 system “ATERUI”. By introducing state-of-the-art CPUs, the theoretical peak performance increased from 502 Tflops to 1.058 Pflops, which means that ATERUI made the leap to become a petaflops computer. The new ATERUI will expand the horizons for simulations to understand the Universe and astrophysical phenomena.



Figure1:The new ATERUI. The number of cabinets decreased to 6. (Credit: NAOJ)

【Background】

Data obtained by observations are snapshots of astronomical phenomena. To understand these data, we need to construct theories based on physics, and conduct experiments based on those theories. However, virtually no astronomical phenomena can be reconstructed in a laboratory due to the spatial and time scales involved. On the other hand, theoretical astronomy tries to understand astronomical phenomena by solving equations. In some cases, it is not easy to solve the equations by hand, so powerful computers assist astronomers. Simulation astronomers construct specific astronomical objects, or even the Universe itself, in computers and perform simulations to compare with the observed Universe. With the rapid progress of computer technology, numerical simulations in astronomy are regarded as the third approach to astronomical research, alongside observational and theoretical astronomy.
CfCA operates supercomputers for astronomical simulations. Cray XC30 system “ATERUI” installed in the NAOJ Mizusawa campus in April 2013 is NAOJ’s 4th generation supercomputer for numerical simulation. This system is a scalar type massively parallel supercomputer. With the theoretical peak performance of 502 Tflops, ATERUI was the world’s fastest supercomputer dedicated to astronomical simulation. ATERUI accelerated our understanding in various fields of astrophysics, but astronomers’ requirements for computer performance have become higher and higher.

【Upgrade of ATERUI】

Responding to the increasing demand, ATERUI had a “surgery” to introduce a new “brain” during September 11th-30th, 2014. In this operation, the old CPUs were exchanged with new CPUs. The number of cabinets decreased from 8 to 6, and the interconnects between CPUs were reconnected. Although the number of cabinets decreased, the theoretical peak performance approximately doubled from 502 Tflops to 1058 Tflops(=1.058 Pflops). This means that ATERUI can perform one thousand trillion calculations per second. This marks the best performance in the world for an astronomical simulation supercomputer. ATERUI became the first petaflops supercomputer operated by NAOJ.



Figure2: A staff member of the Cray Japan Inc. exchanging a blade. 266 blades for calculations were replaced.
(Credit: NAOJ)

The renewed ATERUI has started operation from Oct 1st, 2014 and 127 researchers have been using this new system. The users include researchers and graduate students not only in NAOJ, but also in universities and other institutes in Japan, and Japanese researchers abroad. ATERUI runs various simulations: the formation of planets, the birth and death of stars, the activity of the Sun, the evolution of black holes, the formation of galaxies and clusters of galaxies and the large scale structure of the Universe. For example, in simulations of supernovae and mergers of binary neutron stars, the complicated high-energy physics has to be considered. These simulations need huge computing power, and the new ATERUI will conduct more realistic simulations for these complicated phenomena. In addition, smaller time steps for calculations provide more accurate behaviors for phenomena. The new ATERUI will be able to follow more accurately the motions of particles like stars and fluids like interstellar gas or plasma gas. Moreover, higher spatial resolution provides fine structure for celestial objects and the structure of the Universe. For example, one simulation with new ATERUI can provide various views of the Universe ranging from the large-scale structure down to the scale of individual galaxies.

Professor Eiichiro Kokubo, the CfCA project director says, “Supercomputers for astronomical researches can be called ‘telescopes for theoretical astronomy’ because they illustrate astrophysical phenomena that telescopes cannot see. New visions of the Universe which have never been seen before will be revealed by more realistic simulations using the new ATERUI”.

【Basic specifications of ATERUI】

Before Upgrade
(2013.4-2014.9)
After Upgrade
(2014.10-)
Theoretical Peak Performance 502 Tflops 1058 Tflops (1.058 Pflops)
Total Main Memory 94.25 TB 135.6 TB
CPU Intel® Xeon® Processor E5-2670 (2.6GHz) Intel® Xeon® Processor E5-2690 v3 (2.6GHz)
The number of cores per CPU 8 12
The number of CPUs per a node 2 2
Theoretical Peak Performance per node 332 Gflops 998 Gflops
Main Memory of node 64 GB 128 GB
The number of nodes 1512 (3024 CPU) 1060 (2120 CPU)
The number of cabinets 8 6
The total core number 24,192 25,440


【Gallery】

/ /
Large file JPG(13.7MB) Large file JPG(14.4MB)
/ /
Large file JPG(18.2MB) Large file JPG(20.2MB)
Photo : Makoto Shizugami (VERA/CfCA, NAOJ)
Credit : NAOJ

【Contact】

PR Office of CfCA
Phone: +81-422-34-3836
E-mail: hina_atmark_cfca.jp ( _atmark_=> @ )

【Related Link】

The Fastest Supercomputer for Astronomy Just Went into Operation! (May 29, 2013)

tag: