A general iterative approach for solving the general constrained linear matrix equations system

Abstract

Much of the research which has been done on special kinds of matrix equations has almost the same structure. In this paper, an iterative approach is proposed which is more general and includes all such matrix equations. This approach is based on the global least squares (GL-LSQR) method. To do so, a linear matrix operator, its adjoint and a proper inner product are defined. Then we demonstrate how to employ the new approach for solving the general linear matrix equations system. When the matrix equations are consistent, a least-norm solution can be obtained. Moreover, the optimal approximate solution to a given group of matrices can be derived. Also, some theoretical properties and the error analysis of the new method are discussed. Finally, some numerical experiments are given to compare the new iterative method with some existent methods in terms of their numerical results and illustrate the efficiency of the new method.

Keywords

General matrix equations constrained matrix equations GL-LSQR method linear operator matrix nearness problem

Get full access to this article

View all access options for this article.

References

Aliev

Larin

(1998) Optimization of Linear Control Systems: Analytical Methods and Computational Algorithms (Stability and Control: Theory, Methods and Applications, vol. 8). Philadephia, PA: Gordon and Breach.

Andrew

(1973) Eigenvectors of certain matrices. Linear Algebra and its Applications 7: 157–162.

Bai

(2011) On Hermitian and skew-Hermitian splitting iteration methods for continuous Sylvester equations. Journal of Computational Mathematics 29(2): 185–198.

Björck (1996) Numerical Methods for Least Squares Problems. Philadelphia, PA: SIAM.

Bouhamidi

Jbilou

Reichel

. (2011) An extrapolated TSVD method for linear discrete ill-posed problems with Kronecker structure. Linear Algebra and its Applications 434: 1677–1688.

Cai

Chen

(2009) An iterative method for solving a kind of constrained linear matrix equations system. Computational and Applied Mathematics 28(3): 309–325.

Calvetti

Reichel

(1996) Application of ADI iterative methods to the restoration of noisy images. SIAM Journal on Matrix Analysis and Applications 17 165–186.

Chu

KWE

(1989) Symmetric solutions of linear matrix equations by matrix decompositions. Linear Algebra and its Applications 119: 35–50

Dai

(1989) Singular Control Systems. Springer: Berlin.

10.

Datta

(2004) Numerical Methods for Linear Control Systems. Amsterdam: Elsevier.

11.

Datta

Morgera

(1986) Some results on matrix symmetries and a pattern recognition application. IEEE Transactions on Signal Processing 34: 992–994.

12.

Datta

Morgera

(1989) On the reducibility of centrosymmetric matrices: Applications in engineering problems. Circuits, Systems and Signal Processing 8 (1): 71–96.

13.

Dehghan

Hajarian

(2008) An iterative algorithm for solving a pair of matrix equations AYB = E and CYD = F over generalized centro-symmetric matrices. Computers and Mathematics with Applications 56: 3246–3260, doi:10.1016/j.camwa.2008.07.031.

14.

Dehghan

Hajarian

(2010) The general coupled matrix equations over generalized bisymmetric matrices. Linear Algebra and its Applications 432: 1531–1552

15.

Dehghan

Hajarian

(2011a) Solving the generalized Sylvester matrix equation

\sum_{i = 1}^{p} A_{i} {XB}_{i} + \sum_{j = 1}^{q} C_{j} {YD}_{j} = E

over reflexive and anti-reflexive matrices. International Journal of Control, Automation and Systems 9(1): 118–124.

16.

Dehghan

Hajarian

(2011b) Analysis of an iterative algorithm to solve the generalized coupled Sylvester matrix equations. Applied Mathematical Modelling 35: 3285–3300, doi:10.1016/j.apm.2011.01.022.

17.

Dehghan

Hajarian

(2012) Solving coupled matrix equations over generalized bisymmetric matrices. International Journal of Control, Automation, and Systems 10 (5): 905–912, doi:10.1007/s12555-012-0506-2.

18.

Dieci

Osborne

Russell

(1988) A Riccati transformation method for solving linear BVPs. I: Theoretical aspects. SIAM Journal on Numerical Analysis 25 (5): 1055–1073.

19.

Ding

Chen

(2005a) Gradient based iterative algorithms for solving a class of matrix equations. IEEE Transactions on Automatic Control 50 (8): 1216–1221.

20.

Ding

Chen

(2005b) Iterative least-squares solutions of coupled Sylvester matrix equations. Systems and Control Letters 54 (2): 95–107.

21.

Ding

Chen

(2006) On iterative solutions of general coupled matrix equations. SIAM Journal on Control and Optimization 44 (6): 2269–2284.

22.

Ding

Zhang

(2014) Gradient-based iterative algorithm for a class of the coupled matrix equations related to control systems. IET Control Theory and Applications 8 (15): 1588–1595, doi: 10.1049/iet-cta.2013.1044.

23.

Ding

Liu

Ding

(2008) Iterative solutions of the generalized Sylvester matrix equations by using the hierarchical identification principle. Applied Mathematics and Computation 197: 41–50, doi:10.1016/j.amc.2007.07.040.

24.

Ding

Wang

Ding

(2015) Recursive least squares parameter identification algorithms for systems with colored noise using the filtering technique and the auxiliary model. Digital Signal Processing 37: 100–108, doi.org/10.1016/j.dsp.2014.10.005.

25.

Duan

(2004) The solution to the matrix equation AV + BW = EVJ + R. Applied Mathematics Letters 17: 1197–1202, doi:10.1016/j.aml.2003.05.012.

26.

Enright

(1978) Improving the efficiency of matrix operations in the numerical solution of stiff ordinary differential equations. ACM Transactions on Mathematical Software 4: 127–136, doi:10.1145/355780.355784.

27.

Epton

(1980) Methods for the solution of AXD − BXC = E and its application in the numerical solution of implicit ordinary differential equations. BIT 20: 341–345, doi:10.1007/BF01932775.

28.

Fletcher

Kuatsky

Nichols

(1986) Eigenstructure assignment in descriptor systems. IEEE Transactions on Automatic Control 31 (12): 1138–1141, doi:10.1109/tac.1986.1104189.

29.

Frank

(1990) Fault diagnosis in dynamic systems using analytical and knowledge-based redundancy: A survey and some new results. Automatica 26: 459–474, doi:10.1016/0005-1098(90)90018-D.

30.

Golub

Van Loan

(1996) Matrix Computations. 3rd edn. Baltimore, MD: Johns Hopkins University Press.

31.

Hajarian

(2013) Efficient iterative solutions to general coupled matrix equations. International Journal of Automation and Computing 10 (5): 481–486, doi:10.1007/s11633-013-0745-6.

32.

Hajarian

Dehghan

(2011) The generalized centro-symmetric and least squares generalized centro-symmetric solutions of the matrix equation AXB + CX^tD = E, Mathematical Methods in the Applied Sciences 34: 1562–1579, doi:10.1002/mma.1459.

33.

Hodel

Tenison

(1996) Numerical solution of the Lyapunov equation by approximate power iteration. Linear Algebra and its Applications 236: 205–230, doi:10.1016/0024-3795(94)00155-3.

34.

Jbilou

Messaoudi

Sadok

(1999) Global FOM and GMRES algorithms for matrix equations. Applied Numerical Mathematics 31: 97–109, doi:10.1016/S0168-9274(98)00094-4.

35.

Jiang

Wei

(2003) On solutions of the matrix equations X − AXB = C and

X - A \bar{X} B = C

. Linear Algebra and its Applications 367: 429–436, doi: 10.1016/S0024-3795(02)00633-X.

36.

Kaabi

Toutounian

Kerayechian

(2006) Preconditioned Galerkin and minimal residual methods for solving Sylvester equations. Applied Mathematics and Computation 181 1208–1214.

37.

Khorsand Zak

Toutounian

(2013) Nested splitting CG-like iterative method for solving the continuous Sylvester equation and preconditioning. Advances in Computational Mathematics, doi: 10.1007/s10444-013-9330-3.

38.

Liang

You

Dai

(2007) An efficient algorithm for the generalized centro-symmetric solution of matrix equation AXB = C . Numerical Algorithms 44: 173–184, doi:10.1007/s11075-007-9097-z10.1007/s10444-013-9330-3.

39.

Panjeh Ali Beik

Salkuyeh

(2011) On the global Krylov subspace methods for solving general coupled matrix equations. Computers and Mathematics with Applications 62: 4605–4613, doi:10.1016/j.camwa.2011.10.043.

40.

Peng

Zhang

(2007) The reflexive and anti-reflexive solutions of the matrix equation A^*XB = C. Journal of Computational and Applied Mathematics 200: 749–760, doi:10.1016/j.cam.2006.01.024.

41.

Peng

(2003) The reflexive and anti-reflexive solutions of matrix equation AX = B . Linear Algebra and its Applications 375: 147–155, doi:10.1016/S0024-3795(03)00607-4.

42.

Peng

(2006) An efficient iterative method for solving the matrix equation AXB + CYD = E . Numerical Linear Algebra with Applications 13: 473–485, doi:10.1002/nla.470.

43.

Salkuyeh

Toutounian

(2006) New approaches for solving large Sylvester equations. Applied Mathematics and Computation 173: 9–18, doi:10.1016/j.amc.2005.02.063.

44.

Sima

(1996) Algorithms for Linear-Quadratic Optimization, volume 200 of Pure and Applied Mathematics. Marcel Dekker, Inc., New York, NY.

45.

Chen

(2010) Iterative methods for solving linear matrix equation and linear matrix system. International Journal of Computer Mathematics Vol. 87, No. 4 763–774.

46.

Toutounian

Karimi

(2006) Global least squares method (GL-LSQR) for solving general linear systems with several right-hand sides. Applied Mathematics and Computation 178: 452–460, doi:10.1016/j.amc.2005.11.065.

47.

Trench

(2004) Minimization problems for (R, S)-symmetric and (R, S)-skew symmetric matrices. Linear Algebra and its Applications 389: 23–31, doi:10.1016/j.laa.2004.03.035.

48.

Wang

Cheng

Wei

(2007) Iterative algorithms for solving the matrix equation AXB + CX^TD = E . Applied Mathematics and Computation 187: 622–629, doi:10.1016/j.amc.2006.08.169.

49.

Weaver

(1985) Centrosymmetric (cross-symmetric) matrices, their basic properties, eigenvalues, and eigenvectors. The American Mathematical Monthly 92: 711–717, doi:10.2307/2323222.

50.

Xie

Ding

(2009) Gradient based iterative solutions for general linear matrix equations. Computers & Mathematics with Applications 58: 1441–1448, doi:10.1016/j.camwa.2009.06.047.

51.

Zhang

(2011) A note on the iterative solutions of general coupled matrix equation. Applied Mathematics and Computation 217: 9380–9386, doi:10.1016/j.amc.2011.04.026.