Parallel performance results for the OpenMOC neutron transport code on multicore platforms

Abstract

The shift toward multicore architectures has ushered in a new era of shared memory parallelism for scientific applications. This transition has introduced challenges for the nuclear engineering community, as it seeks to design high-fidelity full-core reactor physics simulation tools. This article describes the parallel transport sweep algorithm in the OpenMOC method of characteristics (MOC) neutron transport code for multicore platforms using OpenMP. Strong and weak scaling studies are performed for both Intel Xeon and IBM Blue Gene/Q (BG/Q) multicore processors. The results demonstrate 100% parallel efficiency for 12 threads on 12 cores on Intel Xeon platforms and over 90% parallel efficiency with 64 threads on 16 cores on the IBM BG/Q. These results illustrate the potential for hardware acceleration for MOC neutron transport on modern multicore and future many-core architectures. In addition, this work highlights the pitfalls of programming for multicore architectures, with a focal point on false sharing.

Keywords

Multicore processors OpenMP neutron transport method of characteristics

Get full access to this article

View all access options for this article.

References

Askew

(1972) A Characteristics Formulation of the Neutron Transport Equation in Complicated Geometries. Techincal Report. AAEW-M 1108, UK Atomic Energy Establishment.

Baker

Davidson

Evans

. (2012) High performance radiation transport simulations: preparing for TITAN. In: Supercomputing 2012, Salt Lake City, UT, 10-16 November 2012. Los Alamitos, CA: IEEE Computer Society Press.

Boyd

Shaner

. (2014) The OpenMOC method of characteristics neutral particle transport code. Annals of Nuclear Energy 68: 43–52.

Boyd

Smith

Forget

(2013) A massively parallel method of characteristic neutral particle transport code for GPUs. In: Proceedings of the International Conference on Mathematics and Computational Methods Applied to Nuclear Science and Engineering, Sun Valley, ID, USA.

Boyd

III WRD

(2014) Massively Parallel Algorithms for Method of Characteristics Neutral Particle Transport on Shared Memory Computer Architectures. M.S. Thesis, Massachusetts Institute of Technology, Cambridge, MA, USA.

Browne

Dongarra

Garner

. (2000) A portable programming interface for performance evaluation on modern processors. International Journal of High Performance Computing Applications 14(3): 189–204.

Gong

Liu

Chi

. (2011) GPU accelerated simulations of 3D deterministic particle transport using discrete ordinate method. Journal of Computational Physics 230(15): 6010–6022.

Horelik

Siegel

Forget

. (2014) Monte Carlo domain decomposition for robust nuclear reactor analysis. Parallel Computing 40(10): 646–660.

Jung

Joo

(2009) Decoupled planar MOC solution for dynamic group constant generation in direct three-dimensional core calculations. In: Proceedings of the International Conference on Mathematics and Computational Methods Applied to Nuclear Science and Engineering, Saratoga Spring, NY, USA.

10.

Kochunas

(2013) A Hybrid Parallel Algorithm for the 3-D Method of Characteristics Solution of the Boltzmann Transport Equation on High Performance Compute Clusters. Ph.D. Dissertation, University of Michigan, Ann Arbor, MI, USA.

11.

Kochunas

Collins

Jabaay

. (2013) Overview of Development and Design of MPACT: Michigan Parallel Characteristics Transport Code, Technical Report. La Grange Park: American Nuclear Society, 2013.

12.

Lewis

Miller

(1984) Computational Methods of Neutron Transport. New York: Wiley.

13.

Lewis

Palmiotti

Taiwo

. (2003) Benchmark Specifications for Deterministic MOX Fuel Assembly Transport Calculations Without Spatial Homogenization. Technical Report. Organisation for Economic Co-operation and Development’s Nuclear Energy Agency.

14.

OpenMP Architecture Review Board (2013) OpenMP Application Program Interface Version 4.0. Available at: http://www.openmp.org/mp-documents/OpenMP4.0.0.pdf (accessed 31 December 2014).

15.

Nelson

(2009) Monte Carlo Methods for Neutron Transport on Graphics Processing Units Using CUDA. M.S. Thesis, Pennsylvania State University, PA, USA.

16.

NVIDIA (2013) NVIDIA CUDA C Programming Guide. Available at: http://docs.nvidia.com/cuda/cuda-c-programming-guide/ (accessed 31 December 2014).

17.

Romano

Forget

(2013) Parallel fission bank algorithms in Monte Carlo criticality calculations. Nuclear Science and Engineering 170: 125–135.

18.

Siegel

Smith

Romano

. (2014) Multi-core performance studies of a Monte Carlo neutron transport code. International Journal of High Performance Computing Applications 28(1): 87–96.

19.

Smith

(1983) Nodal method storage reduction by non-linear iteration. Transactions of the American Nuclear Society 44: 265.

20.

Smith

Rhodes

(2000) CASMO-4 characteristics methods for two-dimensional PWR and BWR core calculations. Transactions of the American Nuclear Society 83: 294.

21.

Smith

Rhodes

(2002) Full-core, 2-D, LWR core calculations with CASMO-4E. In: Proceedings of PHYSOR, Seoul, South Korea, 7-10 October 2002.

22.

Tramm

Siegel

(2013) Memory bottlenecks and memory contention in multi-core Monte Carlo transport codes. In: Joint International Conference on Supercomputing in Nuclear Applications and Monte Carlo, La Cité des Sciences et de l’Industrie, Paris, France, 27-31 October 2013.

23.

Yamamoto

Kitamura

Yamane

(2004) Computational efficiencies of approximated exponential functions for transport calculations of the characteristics method. Annals of Nuclear Energy 2: 1027–1037.

24.

Yang

Satvat

(2012) MOCUM: a two-dimensional method of characteristics code based on constructive solid geometry and unstructured meshing for general geometries. Annals of Nuclear Energy 46: 20–28.

25.

U.S. DOE (1993) DOE Fundamentals Handbook: Nuclear Physics and Reactor Theory, Technical Report. Washington: U.S. Dept. of Energy.