Faculty of Engineering and Applied Science 
 
                          2000 Fall
[Note: if you see symbols like ¹ or Þ in various places, then your browser is not reading the style sheet for this Web page properly (or the Symbol font is not installed on your computer). The translation is:
Þ as Þ (implies),Given the matrices A and X0, given as
        [ 0.5  0.7  0.1 ]          [ 0.8 ]
    A = [ 0.4  0.2  0.6 ] ,   X  = [ 0.2 ]
        [ 0.1  0.1  0.3 ]      0   [ 0.0 ]
    Determine X1 = A X0.
X1 = A X0
      [ 0.5  0.7  0.1 ] [ 0.8 ]   [ (.5*.8 + .7*.2 + .1*0) ]
    = [ 0.4  0.2  0.6 ] [ 0.2 ] = [ (.4*.8 + .2*.2 + .6*0) ]
      [ 0.1  0.1  0.3 ] [ 0.0 ]   [ (.1*.8 + .1*.2 + .3*0) ]
      [ 0.54 ]
    = [ 0.36 ]
      [ 0.10 ]
      ========
    For the matrix
        [ u ]
    X = [ v ]
        [ w ]
        determine values for   u, v and w such
         that Matrix   A - I =
    [-0.5  0.7  0.1 ]
    [ 0.4 -0.8  0.6 ] .
    [ 0.1  0.1 -0.7 ] 
        Method 1:
Solving the homogeneous linear system  
         [(A - I) | 0]:
        Multiply all rows by 10 and swap rows 1 and 3:
    [ 1  1 -7 | 0 ] 
    [ 4 -8  6 | 0 ] 
    [-5  7  1 | 0 ]
        R2 ¬
         R2 - 4 R1,
        R3 ¬
         R3 + 5 R1:
    [ 1   1  -7 | 0 ] 
    [ 0 -12  34 | 0 ] 
    [ 0  12 -34 | 0 ]
        R3 ¬
         R3 + R2, then
        R2 ¬
         R2 / -12:
    [ 1   1   -7  | 0 ] 
    [ 0   1 -17/6 | 0 ] 
    [ 0   0    0  | 0 ]
        R1 ¬
         R1 - R2:
    [ 1   0 -25/6 | 0 ] 
    [ 0   1 -17/6 | 0 ] 
    [ 0   0    0  | 0 ]
        This generates a one-parameter family of solutions
        (u, v, w) = (25, 17, 6) t,  
         where t is any real number.
        However, we also have the constraint
         
        Þ    
         (25 + 17 + 6) t = 1
             Þ    
         t = 1/48
Therefore the unique solution is
                
         (u, v, w) = (25/48, 17/48, 1/8).
Method 2:
Incorporate the constraint  
         
    [-0.5  0.7  0.1 |  0 ]
    [ 0.4 -0.8  0.6 |  0 ]  
    [ 0.1  0.1 -0.7 |  0 ] 
    [  1    1    1  |  1 ]
        Multiply rows 1, 2 and 3 by 10 and swap rows 1 and 3:
    [  1   1  -7 | 0 ] 
    [  4  -8   6 | 0 ]  
    [ -5   7   1 | 0 ]
    [  1   1   1 | 1 ]
        R2 ¬
         R2 - 4 R1,
        R3 ¬
         R3 + 5 R1:
        R4 ¬
         R4 - R1:
    [  1   1  -7 | 0 ] 
    [  0 -12  34 | 0 ] 
    [  0  12 -34 | 0 ]
    [  0   0   8 | 1 ]
        R3 ¬
         R3 + R2, then
        R2 ¬
         R2 / -12 and
        R4 ¬
         R4 / 8 :
    [  1   1   -7  |  0  ] 
    [  0   1 -17/6 |  0  ] 
    [  0   0    0  |  0  ]
    [  0   0    1  | 1/8 ]
        R1 ¬
         R1 - R2 and
        R3 «
         R4:
    [  1   0 -25/6 |  0  ] 
    [  0   1 -17/6 |  0  ] 
    [  0   0    1  | 1/8 ]
    [  0   0    0  |  0  ]
        R1 ¬
         R1 +25/6 R3,
        R2 ¬
         R2 +17/6 R3,
    [  1   0    0  | 25/48 ] 
    [  0   1    0  | 17/48 ] 
    [  0   0    1  |  1/8  ]
    [  0   0    0  |   0   ]
        Therefore the unique solution is
        
| (u, v, w) = (25/48, 17/48, 1/8). | 
[Note: this is the steady state vector for the Markov chain whose transition matrix is A.]