Summary: In the theory of autoregressive model fitting it is of interest to know the asymptotic behaviour, for large sample size, of the coefficients fitted. A significant role is played in this connection by the moments of the norms of the inverse sample covariance matrices. We establish uniform boundedness results for these, first under generally weak conditions and then for the special case of (infinite order) autoregressive processes. These in turn imply corresponding ergodic theorems for the matrices in question.