Solving The Ordinary Least Squares in Closed Form, Without Inversion or Normalization
By connecting the LU factorization and the Gram-Schmidt orthogonalization without any normalization, closed-forms for the coefficients of the ordinary least squares estimates are presented. Instead of using matrix inversion explicitly, each of the coefficients is expressed and computed directly as a linear combination of non-normalized Gram-Schmidt vectors and the original data matrix and also in terms of the upper triangular factor from LU factorization. The coefficients may computed iteratively using backward or forward algorithms given.
READ FULL TEXT