A survey on data replication strategies in a Data Grid environment

Abstract

In a Data Grid Environment, data is often replicated to several sites in order to improve data availability, fault tolerance and faster data access to user requests. Data Grids deals with data intensive applications, which require data to be replicated at multiple locations for the improvement in the overall performance of the application. Data replication must address some of the issues like when to create/delete a replica, how many copies of replicas to create, which files are to be replicated and selection of location for data replication. Several data replication strategies have been proposed in the recent years for Grid computing environment. In this paper, we present a thorough survey on the issues and challenges involved in data replication focusing on the contemporary issues like replica consistency, synchronization and maintenance. A general overview has been given on data replication, describing when replicas can be created/modified and which replica to be selected for use, maintaining optimal number of replicas, maintaining replicas consistency, limitations and their future enhancements.

Keywords

Grid computing Data Grid data replication replica creation replica maintenance replica synchronization replica consistency optimization survey

References

Hsu

C.C.

, Liu

and Wang

C.M.

, Heuristic algorithms for replication transition problem in the grid systems, in: Proc of 8^th IEEE International Symposium on Cluster Computing and Grid, Lyon, France, IEEE (19-22 May 2008), 492-499.

Andrew

T.S.

and van Steen

, Distributed systems-principles and paradigms, Second Edition, Prentice-Hall Inc, 2007.

Domenici

, Donno

, Pucciani

and Stockinger

, Relaxed data consistency with CONStanza, in: Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06), Singapur, IEEE (16-19 May 2006), 425-429.

Buyya

, Economic-based distributed resource management and scheduling for Grid computing, Ph.D Thesis, Monash University, Melbourne, Australia, April 2002, arXiv Preprint Cs/0204048.

Guy

, Kunszt

, Laure

, Stockinger

and Stockinger

, Replica management in data grids, in: Global Grid Forum 5 (July 2002), 278-280.

Bernstein

P.A.

, Hadzilacos

and Goodman

, Concurrency control and recovery in database systems, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1987.

Ranganathan

and Foster

, Design and evaluation of dynamic replication strategies for a high performance data grid, in: International Conference on Computing in High Energy and Nuclear Physics, Beijing, China, (3-7 September 2001).

Ranganathan

and Foster

, Identifying dynamic replication strategies for a high-performance data grid, Grid Computing - GRID, Colorado USA, (November 2001), 75-86.

Ranganathan

and Foster

, Decoupling computation and data scheduling in distributed data-intensive applications, in: High Performance Distributed Computing, HPDC-11 2002 Proceedings 11th IEEE International Symposium, Edinburgh, Scotland, (July 2002), 352-358.

10.

Carman

, Zini

, Serafini

and Stockinger

, Towards an economy-based optimisation of file access and replication on a data grid, 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, Berlin, Germany, (May 2002), 340-340.

11.

Bell

W.H.

, Cameron

D.G.

, Carvajal-Schiaffino

, Millar

A.P.

, Stockinger

and Zini

, Evaluation of an economy-based file replication strategy for a data grid, in: 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2003, Tokyo, Japan, (12-15 May 2003), 661-668.

12.

Haddad

and Slimani

, Economic model for replicated database placement in grid, in: Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid'07), Brazil, (14-17 May 2007), 283-292.

13.

Guy

, Kunszt

, Laure

, Stockinger

and Stockinger

, Replica management in data grids, in: Global Grid Foru 5 (July 2001), 278-280.

14.

Capozza

, Stockinger

and Zini

, Preliminary evaluation of revenue prediction functions for economically-effective file replication, CERN Geneva, Switzerland, Tech Rep DataGrid-02-TED-020724, 24 July 2002.

15.

Ernemann

, Hamscher

and Yahyapour

, Economic scheduling in grid computing, in: Workshop on Job Scheduling Strategies for Parallel Processing, Springer Berlin Heidelberg Edinburgh, Scotland, (July 2002), 128-152.

16.

Naseera

and Murthy

K.M.

, Performance evaluation of predictive replica selection using neural network approaches, in: International Conference on Intelligent Agent & Multi-Agent Systems, IAMA, IEEE (July 2009), 1-6.

17.

Satyanarayanan

, Kistler

J.J.

, Kumar

, Okasaki

M.E.

, Siegel

E.H.

and Steere

D.C.

, Coda: A highly available file system for a distributed workstation environment, IEEE Transactions on Computers 39(4) (1990), 447-459.

18.

J.J.

, Lin

Y.F.

and Liu

, Optimal replica placement in hierarchical data grids with locality assurance, Journal of Parallel and Distributed Computing 68(12) (2008), 1517-1538.

19.

Kalpakis

, Dasgupta

and Wolfson

, Optimal placement of replicas in trees with read, write, and storage costs, IEEE Transactions on Parallel and Distributed Systems 12(6) (June 2001), 628-637.

20.

Lamehamedi

, Shentu

, Szymanski

and Deelman

, Simulation of dynamic data replication strategies in data grids, in: Proc International Parallel and Distributed Processing Symposium, (IPDPS 2003) Nice, France, (22-26 April 2003).

21.

Bernstein

P.A.

and Goodman

, The failure and recovery problem for replicated databases, in: Proceedings of the Second Annual ACM Symposium on Principles of Distributed Computing, ACM New York, (17-19 August 1983), 114-122.

22.

Unger

and Cidon

, Optimal content location in multicast based overlay networks with content updates, World Wide Web 7(3) (2004), 315-336.

23.

Cameron

D.G.

, Carvajal-Schiaffino

, Millar

A.P.

, Nicholson

, Stockinger

and Zini

, Evaluating scheduling and replica optimisation strategies in OptorSim, in: Proceedings of the 4th International Workshop on Grid Computing, Phoenix, USA, IEEE (4-6 June 2003), 52-59.

24.

Sinha

P.K.

, Distributed operating systems concepts & design, PHI, IEEE Computer Society Press, ISBN 0-7803-1119-1, 2001.

25.

Coulouris

, Dollimore

and Kindberg

, Distributed systems, concepts and designs, Third Edition, Addisson Wesley, 2001.

26.

Zhou

, Kim

J.W.

and Yeom

H.Y.

, Recon: A fast and reliable replica retrieval service for the data grid, in: Cluster Computing and the Grid, 2006 CCGRID 06 Sixth IEEE International Symposium on, Singapore 1 (16-19 May 2006), 446-453.

27.

Dullmann

, Hoschek

, Jaen-Martinez

, Segal

, Samar

, Stockinger

and Stockinger

, Models for replica synchronisation and consistency in a data grid, In Proc of 10th IEEE International Symposium on High Performance and Distributed Computing (HPDC-10), San Francisco, California, IEEE (7-9 August 2001), 67-75.

28.

Lin

, Abawajy

J.H.

and Buyya

, Economy-based data replication broker, in: Second IEEE International Conference on e-Science and Grid Computing, e-Science, Amsterdam, Netherlands, (4-6 December 2006), 90-97.

29.

Domenici

, Donno

, Pucciani

, Stockinger

and Stockinger

, Replica consistency in a data grid, Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment 534(1) (November 2004), 24-28.

30.

Korupolu

M.R.

, Plaxton

C.G.

and Rajaraman

, Placement algorithms for hierarchical cooperative caching, Journal of Algorithms 38(1) (2001), 260-302.

31.

Chervenak

, Foster

, Kesselman

, Salisbury

and Tuecke

, The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets, Journal of Network and Computer Applications 23(3) (2000), 187-200.

32.

Rahman

R.M.

, Barker

and Alhajj

, Study of different replica placement and maintenance strategies in data grid, in: Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid'07), Brazil, (14-17 May 2007), 171-178.

33.

Vazhkudai

, Tuecke

and Foster

, Replica selection in the globus data grid, in: Proc of First IEEE/ACM International Symposium on Cluster Computing and the Grid, Brisbane, Australia, IEEE (15-18 May 2001), 106-113.

34.

Rahman

R.M.

, Barker

and Alhajj

, Replica placement design with static optimality and dynamic maintainability, in: Proc of Sixth IEEE International Symposium on Cluster Computing and the Grid, 2006 CCGRID 06, Singapur, IEEE (16-19 May 2006).

35.

Rahman

R.M.

, Barker

and Alhajj

, Replica placement in data grid: Considering utility and risk, in: International Conference on Information Technology: Coding and Computing (ITCC'05), Las Vegas, Nevada, USA, IEEE 1 (4-6 April 2005), 354-359.

36.

Ranganathan

, Iamnitchi

and Foster

, Improving data availability through dynamic model-driven replication in large peer-to-peer communities, in: 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2002, Berlin, Germany IEEE Press, Los Alamitos, CA, IEEE (May 2002), 376-376.

37.

Rahman

R.M.

, Barker

and Alhajj

, A predictive technique for replica selection in grid environment, in: Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid'07), Brazil, IEEE (14-17 May 2007), 163-170.

38.

Feng

and Humphrey

, Eliminating replica selection-using multiple replicas to accelerate data transfer on grids, in: Proceedings Tenth International Conference on Parallel and Distributed Systems, 2004 ICPADS 2004, Newport Beach, CA, (7-9 July 2004), 356-366.

39.

Hoschek

, Jaen-Martinez

, Samar

, Stockinger

and Stockinger

, Data management in an international data grid project, in: International Workshop on Grid Computing, Springer Berlin Heidelberg, Bangalore, India, (17-20 December 2000), 77-90.

40.

Gray

, Helland

, O'Neil

and Shasha

, The dangers of replication and a solution, ACM SIGMOD Record, Third Edition 25(2) (1996), 173-182.

41.

Naseera

and Murthy

K.M.

, Agent based replica placement in a data grid environement, in: Computational Intelligence, Communication Systems and Networks, 2009 CICSYN'09 First International Conference on, IEEE Computer Society Press, Indore (23-25 July 2009), 426-430.

42.

Amjad

, Sher

and Daud

, A survey of dynamic replication strategies for improving data availability in data grids, Future Generation Computer Systems 28(2) (2012), 337-349.

43.

Dayyani

and Khayyambashi

M.R.

, A comparative study of replication techniques in grid computing systems, arXiv Preprint ArXiv:13096723 11 (2013), 64-73.

44.

Tos

et al., Dynamic replication strategies in data grid systems: A survey, The Journal of Supercomputing 71(11) (2015), 4116-4140.

45.

Grace

R.K.

and Manimegalai

, Dynamic replica placement and selection strategies in data grids - A comprehensive survey, Journal of Parallel and Distributed Computing 74(2) (February 2014), 2099-2108.

46.

Zhang

, Xie

, Ma

, Li

and Sun

,A replication strategy based on swarm intelligence in spatial data grid, in: 2010 18th International Conference on Geoinformatics, Beijing, China, IEEE (2010, June), 1-5.

47.

, Yan

, Tian

, Guan

and Lee

, Replica creation strategy based on quantum evolutionary algorithm in data gird, Knowledge-Based Systems 42 (2013), 85-96.

48.

Yang

, Li

, Liu

and Malek

A.-G.

, DRMST: A novel dynamic replica management strategy based on TOPSIS in cloud storage, Journal of Software Engineering 8 (2014), 278-286.

49.

Dayyani

and Khayyambashi

M.R.

, A comparative study of replication techniques in grid computing systems, International Journal of Computer Science and Information Security 11(9) (2013), 64-67. arXiv Preprint ArXiv:13096723.

50.

Dayyani

and Khayyambashi

M.R.

, RDT: A new data replication algorithm for hierarchical data grid, International Journal of Computer Science and Engineering 3(7) (July 2015), 186-197.

51.

Dayyani

and Khayyambashi

M.R.

, A novel replication strategy in data grid environment with a dynamic threshold, International Journal of Computer Science Engineering (IJCSE) 3(5) (2014), 244-252.

52.

Xiong

, Zhu

X.X.

, Han

J.Y.

and Wang

R.C.

, QoS-aware replica placement for data intensive applications, The Journal of China Universities of Posts and Telecommunications 20(3) (2013), 43-47.

53.

Chen

D.W.

, Zhou

S.T.

, Ren

X.Y.

and Qiang

K.O.N.G.

, Method for replica creation in data grids based on complex networks, The Journal of China Universities of Posts and Telecommunications 17(4) (2010), 110-115.

54.

Jaradat

, Amin

A.H.M.

and Zakaria

M.N.

, Balanced QoS replica selection strategy to enhance data grid, in: International Conference on Networking and Information Technology 17 (2011), 356-364.

55.

Signes

A.A.

and Bieniusa

, Adaptive strength geo-replication strategy, in: Proceedings of the First Workshop on Principles and Practice of Consistency for Distributed Data, ACM (April 2015), 3.

56.

Lamehamedi

, Szymanski

, Shentu

and Deelman

, Data replication strategies in grid environments, in: Algorithms and Architectures for Parallel Processing, 2002 Proceedings Fifth International Conference on, Los Alamitos, CA, IEEE (23-25 Oct 2005), 378-383.

57.

Hamrouni

, Hamdeni

and Charrada

F.B.

, Placement strategies in data grids, Multiagent and Grid Systems 11(2) (2015), 95-105.

58.

Bsoul

, Alsarhan

, Otoom

, Hammad

and Al-Khasawneh

, A dynamic replication strategy based on categorization for data grid, Multiagent and Grid Systems 10(2) (2014), 109-118.

59.

Naseera

, Vivekanandan

and Murthy

K.M.

, Data replication using experience based trust in a data grid environment, in: International Conference on Distributed Computing and Internet Technology, Springer Berlin Heidelberg, (December 2008), 39-50.