Block Matrix Inversion

Here are some formula for matrix inversion.

Lemma 1: For a block matrix M=\begin{pmatrix}A & B \\C &D\end{pmatrix}, 
M^{-1}=\begin{pmatrix}(A-B D^{-1} C)^{-1}& -A^{-1}B(D-CA^{-1}B)^{-1}\\-(D-CA^{-1}B)^{-1}CA^{-1}&(D-CA^{-1}B)^{-1}\end{pmatrix}

=\begin{pmatrix}A^{-1}+A^{-1}BS^{-1}CA^{-1}& -A^{-1}BS^{-1}\\-S^{-1}CA^{-1}&S^{-1}\end{pmatrix},
where S=D-CA^{-1}B is basically the Schur's 
complement of block A.

Proof: Let M^{-1}=\begin{pmatrix}E&F\\G&H\end{pmatrix}, M M^{-1}=1 gives us

AE+BG=I
AF+BH=0
CE+DG=0
CF+DH=I

From the four equations, we have
E=(A-BD^{-1}C)^{-1}
F=-A^{-1}B(D-CA^{-1}B)
G=-D^{-1}C(A-BD^{-1}C)^{-1}
H=(D-CA^{-1}B)^{-1}

And similarly from M^{-1}M=I, we have

E=(A-BD^{-1}C)^{-1}
F=-(A-BD^{-1}C)^{-1}BD^{-1}
G=-(D-CA^{-1}B)^{-1}CA^{-1}
H=(D-CA^{-1}B)^{-1}

Together, they show the first inequality. Also note that AE+BG=I and thus E=A^{-1}-A^{-1}BG. Substituting G into above shows the second equality. \Box.

Lemma 2 (Matrix Inversion Formula/Woodbury Matrix Identity): 
(A+BDC)^{-1}=A^{-1}-A^{-1}B(D^{-1}+CA^{-1}B)^{-1}CA^{-1}

Proof: From the previous proof, we have E=(A-BD^{-1}C)^{-1}=A^{-1}+A^{-1}B(D-CA^{-1}B)^{-1}CA^{-1}. We get the identity immediately as we flip the sign of B.  \Box

20 Replies to “Block Matrix Inversion”

  1. I’ve been exploring for a bit for any high-quality articles or weblog posts in this sort of house .
    Exploring in Yahoo I eventually stumbled upon this
    web site. Studying this information So i’m happy to convey that I
    have a very excellent uncanny feeling I came upon just what I
    needed. I so much undoubtedly will make certain to do not fail
    to remember this website and give it a look regularly.

  2. This design is spectacular! You certainly know how to keep
    a reader amused. Between your wit and your videos, I was almost moved to start my own blog (well, almost…HaHa!)
    Great job. I really enjoyed what you had to say, and more than that, how you
    presented it. Too cool!

  3. Pretty section of content. I just stumbled upon your website and in accession capital to assert that I get in fact enjoyed
    account your blog posts. Anyway I’ll be subscribing to your augment and even I achievement you access consistently fast.

  4. Thanks so much regarding giving everyone an update on this matter
    on your web site. Please understand that if a completely new
    post becomes available or in the event that any adjustments occur with the current
    publication, I would consider reading a lot more and knowing how to
    make good use of those techniques you share. Thanks for your time
    and consideration of other people by making your
    blog available.

  5. I got this web page from my buddy who shared with me concerning this site and at the moment
    this time I am visiting this web site and reading very informative articles at this time.

  6. I carry on listening to the newscast talk about getting boundless
    online grant applications so I have been looking around for the top
    site to get one. Could you tell me please, where could i find some?

Leave a Reply

Your email address will not be published. Required fields are marked *