Gauss-Seidel method

The choice M=D+L, which reuses each freshly computed component within the same iteration, and why it often converges faster than Jacobi.

Use the new values immediately

Gauss-Seidel takes M=D+LM=D+L and N=UN=-U. As soon as it computes x1(k+1)x_1^{(k+1)}, it uses it to compute x2(k+1)x_2^{(k+1)}, and so on within the same iteration.

x(k+1)=(D+L)1Ux(k)+(D+L)1b  (D+L)x(k+1)=bUx(k)x^{(k+1)}=-(D+L)^{-1}U\,x^{(k)}+(D+L)^{-1}b\ \Longleftrightarrow\ (D+L)x^{(k+1)}=b-Ux^{(k)}
xi(k+1)=1aii(bij<iaijxj(k+1)j>iaijxj(k))x_i^{(k+1)}=\frac{1}{a_{ii}}\left(b_i-\sum_{j<i} a_{ij}x_j^{(k+1)}-\sum_{j>i} a_{ij}x_j^{(k)}\right)