On the Efficiencies of Several Generalized Least Squares Estimators in a Seemingly Unrelated Regression Model and a Heteroscedastic Model (original) (raw)
Related papers
Generalized Automatic Least Squares: Efficiency Gains from Misspecified Heteroscedasticity Models
arXiv (Cornell University), 2023
It is well known that in the presence of heteroscedasticity ordinary least squares estimator is not efficient. I propose a generalized automatic least squares estimator (GALS) that makes partial correction of heteroscedasticity based on a (potentially) misspecified model without a pretest. Such an estimator is guaranteed to be at least as efficient as either OLS or WLS but can provide some asymptotic efficiency gains over OLS if the misspecified model is approximately correct. If the heteroscedasticity model is correct, the proposed estimator achieves full asymptotic efficiency. The idea is to frame moment conditions corresponding to OLS and WLS squares based on miss-specified heteroscedasticity as a joint generalized method of moments estimation problem. The resulting optimal GMM estimator is equivalent to a feasible GLS with estimated weight matrix. I also propose an optimal GMM variance-covariance estimator for GALS to account for any remaining heteroscedasticity in the residuals. JEL Classification: C30.
Journal of Mathematics and Statistics, 2008
The Classical Linear Regression Model assumes that regressors are non-stochastic, independent and uncorrelated with the error terms. These assumptions are not always tenable especially where regressors are not often assumed fixed in repeated sampling. In this paper, with stochastic regressors, the performances of the Ordinary Least Square (OLS) and some Generalized Least Square (GLS) estimators are investigated and compared under various degree of non-validity of multicollinearity and correlation between regressor and error terms' assumptions through Monte-Carlo studies at both low and high replications. The mean squared error criterion is used to examine and compare the estimators. Results show that the performances of the estimators improved with increased replication. The ML and MLGD (GLS) estimators compare favorably with the OLS estimator with low replication. However with increased replication, the OLS method is preferred among the estimators in estimating all the parameters of the model in all level of correlations.
Efficiency gains in least squares estimation: A new approach
Econometric Reviews
A. Mathematical derivations A1. The basic estimator expression A2. The infeasible PHLS estimator A3. The HOLS estimator A4. Homoskedasticity A5. Conditional heteroskedasticity A6. Estimating the HOLS VCV matrix A7. The HOLS estimator with Instrumental Variables B. Details of simulation studies and additional results B1. Homoskedasticity B2. Conditional heteroskedasticity B3. The IV-HOLS estimator under homoskedasticity C. The case of unconditional heteroskedasticity C1. Theoretical results C2. Simulation results (MSE and Bias)
On Comparative Modeling Of Gls And Ols Estimating Techniques
In this study GLS and OLS estimating techniques were compared. To achieve the goal, GLS and OLS estimating techniques were applied on a simultaneous equation models (that is Per Capital Gross Domestic Product equation model and Foreign Direct Investment equation model). Annual data was collected for Per Capital Gross Domestic Product, Foreign Direct Investment, Lending Rate of Interest and Exchange Rate Index for the period of 1983 to 2008 from the National Bureau of Statistics (NBS) and Central Bank of Nigeria Statistical Bulleting (2009). Results from the analysis showed that GLS and OLS estimating techniques produced the same values of coefficients and standard errors in the two equations. The study however concluded that the two estimators are both efficient alike, which shows that the GLS estimator is an OLS estimator of a transformed isomorphic model. The R-package of statistical software was adopted. The two estimators provide BLUE (Best Linear Unbiased Estimator) under heteroscedasticity/serial correlation. KEY WORDS: Generalized Least Squares (GLS), Ordinary Least Square (OLS)
Optimal Generalized Biased Estimator in Linear Regression Model
Open Journal of Statistics, 2015
The paper introduces a new biased estimator namely Generalized Optimal Estimator (GOE) in a multiple linear regression when there exists multicollinearity among predictor variables. Stochastic properties of proposed estimator were derived, and the proposed estimator was compared with other existing biased estimators based on sample information in the the Scalar Mean Square Error (SMSE) criterion by using a Monte Carlo simulation study and two numerical illustrations.
A Note on Variance Estimation for the Generalized Regression Predictor
Australian <html_ent glyph="@amp;" ascii="&"/> New Zealand Journal of Statistics, 2005
The generalized regression (GREG) predictor is used for estimating a finite population total when the study variable is well-related to the auxiliary variable. In 1997, Chaudhuri & Roy provided an optimal estimator for the variance of the GREG predictor within a class of non-homogeneous quadratic estimators (H ) under a certain superpopulation model M. They also found an inequality concerning the expected variances of the estimators of the variance of the GREG predictor belonging to the class H under the model M. This paper shows that the derivation of the optimal estimator and relevant inequality, presented by Chaudhuri & Roy, are incorrect.
Improved heteroscedasticity‐consistent covariance matrix estimators
2000
The heteroskedasticity-consistent covariance matrix estimator proposed by , also known as HC0, is commonly used in practical applications and is implemented into a number of statistical software. Cribari-Neto, Ferrari and Cordeiro have developed a bias-adjustment scheme that delivers bias-corrected White estimators. There are several variants of the original White estimator that are also commonly used by practitioners.
This study investigated the efficiency of Seemingly Unrelated Regression (SUR) estimator of Feasible Generalized Least Square (FGLS) compared to robust MM-BISQ, M-Huber, and Ordinary Least Squares (OLS) estimators when the variances of the error terms are non-constant and the distribution of the response variables is not Gaussian. The finite properties and relative performance of these other estimators to OLS were examined under four forms of heteroscedasticity of the error terms, levels of Contemporaneous Correlation (Cc) with gamma responses. The efficiency of four estimation techniques for the SUR model was examined using the Root Mean Square Error (RMSE) criterion to determine the best estimator(s) under different conditions at various sample sizes. The simulation results revealed that the SUR estimator (FGLS) showed superior performance in the small sample situations when the contemporaneous correlation (ρ) is almost perfect (ρ=0.95) with the gamma response model while MM-BISQ was the best under low contemporaneous correlation. The relative efficiencies of MM-BISQ, M-Huber and FGLS estimators over the OLS are respectively 89%, 71%, and 14% in a small sample (≤ 30) and 49%, 32% and 1% in large sample sizes (> 30) under gamma response model. The study concluded that MM-BISQ and M-Huber estimators are the most efficient estimators for modeling systems of simultaneous equations with non-Gaussian responses under either homoscedastic or multiplicative heteroscedastic error terms irrespective of the sample size.