A Detailed Performance Analysis of the Interpolation Supplemented Lattice Boltzmann Method on the Cray T3E and Cray X1A Detailed Performance Analysis of the Interpolation Supplemented Lattice Boltzmann Method on the Cray T3E and Cray X1

Abstract

A detailed study of the parallel performance of the interpolation supplemented lattice Boltzmann (ISLB) method using SHMEM and MPI on the Cray T3E-900 and Cray X1 architectures is presented. The noteworthy feature of the present implementation of the ISLB method is that it is able to achieve a sustained speed of 4.2 Tflop/s while using 504 processors on a Cray X1. The code is shown to achieve super-linear speedups on the Cray T3E-900. It is shown through detailed profiling that the computation and the communication scale well on the Cray X1, although the overall speedup is adversely affected by the cost of barrier synchronization.

Keywords

Shared memory multiprocessors parallel computing SHMEM MPI

Get full access to this article

View all access options for this article.

References

Babu, V. and Korpela, S. A. 1993. On the direct solution of Poisson’s equation on a nonuniform grid . J. Comp. Physics 104: 93–98 .

Baskar, G. and Babu, V. 2004. Simulation of the unsteady flow around rectangular cylinders using the ISLB method. AIAA Paper 2004-2651, 34th AIAA Fluid Dynamics Conference and Exhibit, Portland, Oregon, USA .

Bhatnagar, P. L. , Gross, E. P. , and Krook, M. 1954. A model for collision processes for gases: I. Small amplitude processes in charged and neutral one component systems . Phys. Rev. E 94: 511–525 .

Chen, H. , Chen, S. , and Matthaeus, W. H. 1992. Recovery of the Navier-Stokes equations using a lattice-gas Boltzmann method . Phys. Rev. A 45: R5339-R5339 .

Chen, S. and Doolen, G. D. 1998. Lattice Boltzmann method for fluid flows . Annual Review of Fluid Mechanics 30: 329–364 .

Cohen, E. D. G. 1993. Fifty years of kinetic theory . Physica A 194: 229–257 .

Filippova, O. and Hanel, D. 1998. Grid refinement for lattice-BGK models . J. Comput. Phys. 147: 219–228 .

Filippova, O. and Hanel, D. 2000. Acceleration of lattice-BGK schemes with grid refinement . J. Comput. Phys. 165: 407–427 .

Giovanni, P. , Massaioli, F. , and Succi, S. 1994. High-resolution lattice-Boltzmann computing on the IBM SPI scalable parallel computer . Computers in Physics. 8(6): 705-705 .

10.

He, X. and Doolen, G. 1997. Lattice Boltzmann method on curvilinear coordinates system: Flow around a circular cylinder . J. Comput. Phys. 134: 306–315 .

11.

He, X. and Luo, L. S. 1997a. A priori derivation of the lattice Boltzmann equation . Phys. Rev. E 55: R6333-R6333 .

12.

He, X. and Luo, L. S. 1997b. Theory of the lattice Boltzmann method: From Boltzmann equation to the lattice Boltzmann equation . Phys. Rev. E 56:(6) 6811–6817 .

13.

He, X. , Luo, L. S. , and Dembo, M. 1996. Some progress in lattice Boltzmann method. Part 1. Nonuniform mesh grids . J. Comput. Phys. 129: 357–363 .

14.

Hou, S. , Zou, Q. , Chen, S. , Doolen, G. , and Cogley . 1995. Simulation of cavity flow by the lattice Boltzmann method . J. Comput. Phys. 118: 329–347 .

15.

Mei, R. , Luo, L. S. , and Shyy, W. 1999. An Accurate Curved Boundary Treatment in the Lattice Boltzmann Method . J. Comput. Phys. 155: 307–330 .

16.

Mei, R. , Shyy, W. , Yu, D. , and Luo, L. S. 2000. Lattice Boltzmann Method for 3D Flows with Curved Boundary . J. Comput. Phys. 161: 680–699 .

17.

Qian, Y. H. , D’Humiéres, D. , and Lallemand, P. 1992. Lattice BGK models for the Navier-Stokes equation . Europhys. Lett. 17: 479–484 .

18.

Succi, S. 2001. The Lattice Boltzmann Equation for Fluid Dynamics and Beyond. Oxford University Press .

19.

Shyam Sunder, C. , Baskar, G. , Babu, V. , and Strenski, D. 2003. Parallel Performance of the Interpolation Supplemented Lattice Boltzmann Method . Proceedings of the 10th International Conference on High Performance Computing (HiPC03), Vol. 2913 of Lecture Notes in Computer Science, Springer-Verlag, Berlin, pp. 428–437 .

20.

Worley, P. H. and Dunigan, T. H. Jr . 2003. Early Performance Evaluation of the Cray X1 at Oak Ridge National Laboratory . Proceedings of the 45th Cray User Group Conference, May 12–16, Columbus, Ohio, USA.