In this paper we examine the topic of writing fault-tolerant Message Passing
Interface (MPI) applications. We discuss the meaning of fault tolerance in general
and what the MPI Standard has to say about it. We survey several approaches to this
problem, namely checkpointing, restructuring a class of standard MPI programs,
modifying MPI semantics, and extending the MPI specification. We conclude that,
within certain constraints, MPI can provide a useful context for writing application
programs that exhibit significant degrees of fault tolerance.
Batchu, R.
,
Neelamegam, J.
,
Dui, Z.
,
Beddhua, M.
,
Skjellum, A.
,
Dandass, Y.
, and
Apte, M.
2001.
MPI/FT (TM): Architecture and taxonomies for fault-tolerant,
message-passing middleware for performance-portable parallel computing
. In Proceedings of the 1st IEEE International Symposium of
Cluster Computing and the Grid, Melbourne, Australia.
2.
Bosilca, G.
,
Bouteiller, A.
,
Cappello, F.
,
Djilali, S.
,
Fedak, G.
,
Germain, C.
,
Herault, T.
,
Lemarinier, P.
,
Lodygensky, O.
,
Magniette, F.
,
Neri, V.
, and
Selikhov, A.
2002.
MPICH-V: Toward a scalable fault tolerant MPI for volatile nodes
. In Proceedings of SC 2002, IEEE.
3.
Butler, R.
,
Gropp, W.
, and
Lusk, E.2001.
Components and interfaces of a process management system for parallel programs
. Parallel Computing, 27:
1417-1429
.
4.
Fagg, G.
and
Dongarra, J.
2000.
Fault-tolerant MPI: Supporting dynamic applications in a dynamic world
. In
J. Dongarra
,
P. Kacsuk
, and
N. Podhorszki
, editors, Recent Advances in Parallel Virutal Machine and Message
Passing Interface, 7th European PVM/MPI Users’ Group Meeting
No 1908 in Springer Lecture Notes in Computer Science, pp.
346-353
.
5.
Fagg, G.E.
and
Dongarra, J.J.2004.
Building and using a fault tolerant MPI implementation
. International Journal of High Performance Computer Applications and
Supercomputing, in press.
6.
Fagg, G.E.
,
Bukovsky, A.
, and
Dongarra, J.J.2001.
HARNESS and fault tolerant MPI
. Parallel Computing, 27(11):
1479-1495
.
7.
Geist, A.
and
Engelmann, C.2004.
Development of naturally fault tolerant algorithms for computing on 100,000 processors
. Journal of Parallel and Distributed Computing, submitted.
8.
Gray, J.
and
Reuter, A.1993. Transaction Processing.
Morgan Kaufmann, San Mateo, CA
.
9.
Gropp, W.
and
Lusk, E.
1995.
Dynamic process management in an MPI setting
. In Proceedings of the 7th IEEE Symposium on Parallel and
Distributed Processing, October 25-28,
San Antonio, TX, IEEE Computer Society Press, pp.
530-534
.
10.
Gropp, W.
,
Lusk, E.
, and
Skjellum, A.1999. Using MPI: Portable Parallel Programming with the Message
Passing Interface, 2nd edition.
MIT Press, Cambridge, MA
.
11.
Li, K.
,
Naughton, J.F.
, and
Plank, J.S.1992.
An efficient checkpointing method for multicomputers with wormhole routing
. International Journal of Parallel Processing,
20(3):
150-180
.
12.
Li, K.
,
Naughton, J.F.
, and
Plank, J.S.1994.
Low-latency, concurrent checkpointing for parallel programs
. IEEE Transactions on Parallel and Distributed Systems, 5(8):
874-879
.
13.
Louca, S.
,
Neophytou, N.
,
Lachanas, A.
, and
Evrepidou, P.2000.
MPI-FT: Portable fault tolerance scheme for MPI
. Parallel Processing Letters, 10(4):
371-382
.
14.
Message Passing Interface Forum
. 1994.
MPI: A Message-Passing Interface standard
. International Journal of Supercomputer Applications, 8(3/4):
165-414
.
15.
Message Passing Interface Forum
. 1995. The MPI message-passing interface standard. http://www.mpi-forum.org.
16.
Rao, S.
,
Alvisi, L.
, and
Vin, H.M.
1999.
Egida: an extensible tookit for low-overhead fault-tolerance
. In Symposium on Fault-Tolerant Computing, pp.
48-55
.
17.
Snir, M.
,
Otto, S.W.
,
Huss-Lederman, S.
,
Walker, D.W.
, and
Dongarra, J.1998. MPI—The Complete Reference: Volume 1, The MPI
Core, 2nd edition.
MIT Press, Cambridge, MA
.
18.
Stellner, G.
1996.
CoCheck: checkpointing and process migration for MPI
. In Proceedings of IPPS ’96. The 10th International
Parallel Processing Symposium, April 15-19,
Honolulu, HI, IEEE Computer Society Press, pp.
526-531
.
