Matrix Algebra

List of exercises xi Preface to the series xxv Preface xxix Vectors 1(14) Real vectors 4(7) Complex vectors 11(4) Matrices 15(28) Real matrices 19(20) Complex matrices 39(4) Vector spaces 43(30) Complex and real vector spaces 47(14) Inner-product space 61(6) Hilbert space 67(6) Rank, inverse, and determinant 73(24) Rank 75(8) Inverse 83(4) Determinant 87(10) Partitioned matrices 97(34) Basic results and multiplication relations 98(5) Inverses 103(6) Determinants 109(10) Rank (in)equalities 119(7) The sweep operator 126(5) Systems of equations 131(24) Elementary matrices 132(5) Echelon matrices 137(6) Gaussian elimination 143(5) Homogeneous equations 148(3) Nonhomogeneous equations 151(4) Eigenvalues, eigenvectors, and factorizations 155(54) Eigenvalues and eigenvectors 158(17) Symmetric matrices 175(7) Some results for triangular matrices 182(5) Schur's decomposition theorem and its consequences 187(5) Jordan's decomposition theorem 192(9) Jordan chains and generalized eigenvectors 201(8) Positive (semi)definite and idempotent matrices 209(34) Positive (semi)definite matrices 211(17) Partitioning and positive (semi)definite matrices 228(3) Idempotent matrices 231(12) Matrix functions 243(30) Simple functions 246(9) Jordan representation 255(10) Matrix-polynomial representation 265(8) Kronecker product, vec-operator, and Moore-Penrose inverse 273(26) The Kronecker product 274(7) The vec-operator 281(3) The Moore-Penrose inverse 284(8) Linear vector and matrix equations 292(3) The generalized inverse 295(4) Patterned matrices: commutation-and duplication matrix 299(22) The commutation matrix 300(7) The symmetrizer matrix 307(4) The vech-operator and the duplication matrix 311(7) Linear structures 318(3) Matrix inequalities 321(30) Cauchy-Schwarz type inequalities 322(3) Positive (semi)definite matrix inequalities 325(16) Inequalities derived from the Schur complement 341(2) Inequalities concerning eigenvalues 343(8) Matrix calculus 351(46) Basic properties of differentials 355(1) Scalar functions 356(4) Vector functions 360(1) Matrix functions 361(3) The inverse 364(4) Exponential and logarithm 368(1) The determinant 369(4) Jacobians 373(2) Sensitivity analysis in regression models 375(3) The Hessian matrix 378(4) Least squares and best linear unbiased estimation 382(5) Maximum likelihood estimation 387(4) Inequalities and equalities 391(6) Appendix A: Some mathematical tools 397(18) A.1 Some methods of indirect proof 397(1) A.2 Primer on complex numbers and polynomials 398(3) A.3 Series expansions 401(8) A.3.1 Sequences and limits 402(1) A.3.2 Convergence of series 403(1) A.3.3 Special series 404(3) A.3.4 Expansions of functions 407(1) A.3.5 Multiple series, products, and their relation 408(1) A.4 Further calculus 409(6) A.4.1 Linear difference equations 409(1) A.4.2 Convexity 410(1) A.4.3 Constrained optimization 410(5) Appendix B: Notation 415(8) B.1 Vectors and matrices 415(3) B.2 Mathematical symbols, functions, and operators 418(5) Bibliography 423(3) Index 426