Mike Brick | Westat, Inc. (original) (raw)
Papers by Mike Brick
National Center For Education Statistics, 2004
Journal of Economic and Social Measurement, 2015
This paper identifies new opportunities for innovation and expansion on current survey practice i... more This paper identifies new opportunities for innovation and expansion on current survey practice in the design of a new household panel survey, including an increased use of new and mobile technologies, more frequent data collection, modified clustering, and use of non-traditional survey measures such as administrative data, planned missing/matrix sampling questionnaire design, real-time data collection, and biomarkers. These innovative data collection methods require rethinking traditional panel survey methods, but can help reduce respondent burden and expand on current social science knowledge. The paper concludes that a new household panel survey would improve knowledge about important social, economic and health issues facing the US, and would provide a useful test bed for new hypotheses and innovative methods of data collection.
Census Transportation Planning Products (CTPP) are sets of tabulated data products designed for t... more Census Transportation Planning Products (CTPP) are sets of tabulated data products designed for transportation planners. As the underlying data are moving from the Census Long Form sample to the smaller American Community Survey (ACS) five-year combined sample, disclosure risk becomes a non-avoidable concern, especially for small geographic areas. A perturbation approach was developed so that the CTPP products based on the perturbed data satisfy the transportation data user community’s analytical needs while simultaneously satisfying the requirements set by the U.S. Census Bureau for reducing disclosure risk. This paper discusses the variance estimation on the CTPP tables using perturbed ACS data. The ACS uses the Successive Difference Replication (SDR) method for variance estimation because it has the advantage that the variance estimates can be computed regardless of the form of the statistics or the complexity of the design. However, the SDR estimator applied naively to the pertu...
Census Transportation Planning Products (CTPP) are sets of tabulated data products designed for t... more Census Transportation Planning Products (CTPP) are sets of tabulated data products designed for transportation planners. As the underlying data are moving from the Census Long Form sample to the smaller American Community Survey (ACS) five-year combined sample, disclosure risk becomes a non-avoidable concern, especially for small geographic areas. A perturbation approach was developed so that the CTPP products based on the perturbed data satisfy the transportation data user community's analytical needs while simultaneously satisfying the requirements set by the U.S. Census Bureau for reducing disclosure risk. This paper discusses the variance estimation on the CTPP tables using perturbed ACS data. The ACS uses the Successive Difference Replication (SDR) method for variance estimation because it has the advantage that the variance estimates can be computed regardless of the form of the statistics or the complexity of the design. However, the SDR estimator applied naively to the p...
Missing data is a common problem in virtually all surveys. This study focuses on variance estimat... more Missing data is a common problem in virtually all surveys. This study focuses on variance estimation and its consequences for analysis of survey data from the National Center for Education Statistics (NCES). Methods suggested by C. Sarndal (1992), S. Kaufman (1996), and S. Shao and R. Sitter (1996) are reviewed in detail. In section 3, the bootstrap method of Shao and Sitter is applied to the Schools and Staffing Survey (SASS) 1993-94 Public School Teacher Survey component to assess the magnitude of imputation variance. This method is appealing, but requires repeated imputations, so for large scale surveys, the data files become too large. The empirical study shows, however, that using the hot deck imputation method in the 1993-94 SASS can affect the standard error seriously. However, the majority of items have very low stage 2 (hot deck) imputation rates. When the imputation rate is low, the inflation in variance is not severe. It appears feasible for NCES to compute imputation rates and document the problem with the next user's manual. (Contains 8 tables and 11 references.) (SLD)
This paper identifies new opportunities for innovation and expansion on current survey practice i... more This paper identifies new opportunities for innovation and expansion on current survey practice in the design of a new household panel survey, including an increased use of new and mobile technologies, more frequent data collection, modified clustering, and use of non-traditional survey measures such as administrative data, planned missing/matrix sampling questionnaire design, real-time data collection, and biomarkers. These innovative data collection methods require rethinking traditional panel survey methods, but can help reduce respondent burden and expand on current social science knowledge. The paper concludes that a new household panel survey would improve knowledge about important social, economic and health issues facing the US, and would provide a useful test bed for new hypotheses and innovative methods of data collection.
National Center For Education Statistics, 2004
Journal of Economic and Social Measurement, 2015
This paper identifies new opportunities for innovation and expansion on current survey practice i... more This paper identifies new opportunities for innovation and expansion on current survey practice in the design of a new household panel survey, including an increased use of new and mobile technologies, more frequent data collection, modified clustering, and use of non-traditional survey measures such as administrative data, planned missing/matrix sampling questionnaire design, real-time data collection, and biomarkers. These innovative data collection methods require rethinking traditional panel survey methods, but can help reduce respondent burden and expand on current social science knowledge. The paper concludes that a new household panel survey would improve knowledge about important social, economic and health issues facing the US, and would provide a useful test bed for new hypotheses and innovative methods of data collection.
Census Transportation Planning Products (CTPP) are sets of tabulated data products designed for t... more Census Transportation Planning Products (CTPP) are sets of tabulated data products designed for transportation planners. As the underlying data are moving from the Census Long Form sample to the smaller American Community Survey (ACS) five-year combined sample, disclosure risk becomes a non-avoidable concern, especially for small geographic areas. A perturbation approach was developed so that the CTPP products based on the perturbed data satisfy the transportation data user community’s analytical needs while simultaneously satisfying the requirements set by the U.S. Census Bureau for reducing disclosure risk. This paper discusses the variance estimation on the CTPP tables using perturbed ACS data. The ACS uses the Successive Difference Replication (SDR) method for variance estimation because it has the advantage that the variance estimates can be computed regardless of the form of the statistics or the complexity of the design. However, the SDR estimator applied naively to the pertu...
Census Transportation Planning Products (CTPP) are sets of tabulated data products designed for t... more Census Transportation Planning Products (CTPP) are sets of tabulated data products designed for transportation planners. As the underlying data are moving from the Census Long Form sample to the smaller American Community Survey (ACS) five-year combined sample, disclosure risk becomes a non-avoidable concern, especially for small geographic areas. A perturbation approach was developed so that the CTPP products based on the perturbed data satisfy the transportation data user community's analytical needs while simultaneously satisfying the requirements set by the U.S. Census Bureau for reducing disclosure risk. This paper discusses the variance estimation on the CTPP tables using perturbed ACS data. The ACS uses the Successive Difference Replication (SDR) method for variance estimation because it has the advantage that the variance estimates can be computed regardless of the form of the statistics or the complexity of the design. However, the SDR estimator applied naively to the p...
Missing data is a common problem in virtually all surveys. This study focuses on variance estimat... more Missing data is a common problem in virtually all surveys. This study focuses on variance estimation and its consequences for analysis of survey data from the National Center for Education Statistics (NCES). Methods suggested by C. Sarndal (1992), S. Kaufman (1996), and S. Shao and R. Sitter (1996) are reviewed in detail. In section 3, the bootstrap method of Shao and Sitter is applied to the Schools and Staffing Survey (SASS) 1993-94 Public School Teacher Survey component to assess the magnitude of imputation variance. This method is appealing, but requires repeated imputations, so for large scale surveys, the data files become too large. The empirical study shows, however, that using the hot deck imputation method in the 1993-94 SASS can affect the standard error seriously. However, the majority of items have very low stage 2 (hot deck) imputation rates. When the imputation rate is low, the inflation in variance is not severe. It appears feasible for NCES to compute imputation rates and document the problem with the next user's manual. (Contains 8 tables and 11 references.) (SLD)
This paper identifies new opportunities for innovation and expansion on current survey practice i... more This paper identifies new opportunities for innovation and expansion on current survey practice in the design of a new household panel survey, including an increased use of new and mobile technologies, more frequent data collection, modified clustering, and use of non-traditional survey measures such as administrative data, planned missing/matrix sampling questionnaire design, real-time data collection, and biomarkers. These innovative data collection methods require rethinking traditional panel survey methods, but can help reduce respondent burden and expand on current social science knowledge. The paper concludes that a new household panel survey would improve knowledge about important social, economic and health issues facing the US, and would provide a useful test bed for new hypotheses and innovative methods of data collection.