Data and methods for analyzing special interest influence in rulemaking (original) (raw)

Abstract

The US government creates astonishingly complete records of policy creation in executive agencies. In this article, we describe the major kinds of data that have proven useful to scholars studying interest group behavior and influence in bureaucratic politics, how to obtain them, and challenges that we as users have encountered in working with these data. We discuss established databases such as regulations.gov, which contains comments on draft agency rules, and newer sources of data, such as ex-parte meeting logs, which describe the interest groups and individual lobbyists that bureaucrats are meeting face-to-face about proposed policies. One challenge is that much of these data are not machine-readable. We argue that scholars should invest in several projects to make these datasets machine-readable and to link them to each other as well as to other databases.

Access this article

Log in via an institution

Subscribe and save

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. An API is a set of procedures that allow a user to access data from a website in a structured way. Some websites, like regulations.gov, limit API usage by requiring users to get an API key, see https://regulationsgov.github.io/developers/.
  2. The difference between the number of reported comments and the number of comments on regulations.gov is often because some agencies group mass-comment campaigns into a single document. A small number of comments on regulations.gov are duplicates posted in error. To resolve a discrepancy, we recommend searching the agency’s website or contacting the agency directly.
  3. For example, the Federal Energy Regulatory Commission has posted all comments they receive on their eLibrary website, but not all of these appear on regulations.gov. Unlike regulations.gov, most agency sites do not have an API and thus require bespoke web scrapers. We offer examples of scrapers for regulations.gov and several of these agencies on https://github.com/libgober/regdata.
  4. Note that the dataset (Bolton et al. 2019) used is not public.
  5. These data exclude at least 16 agencies and, within the covered agencies, law enforcement officers, nuclear engineers, and certain investigators (Singer-Vine 2017).
  6. Only the metadata (e.g., names) are machine-readable.
  7. However, because rules are usually published as PDFs, converting them to raw text for analysis introduces errors.
  8. The Unified Agenda from 1983 through 1994 is available in the Federal Register.

References

Download references

Author information

Authors and Affiliations

  1. Harvard University, 1737 Cambridge Street, Room 423, Cambridge, MA, 02138, USA
    Daniel Carpenter & Steven Rashin
  2. University of Wisconsin, Madison, USA
    Devin Judge-Lord
  3. Yale University, New Haven, USA
    Brian Libgober

Authors

  1. Daniel Carpenter
  2. Devin Judge-Lord
  3. Brian Libgober
  4. Steven Rashin

Corresponding author

Correspondence toSteven Rashin.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

About this article

Cite this article

Carpenter, D., Judge-Lord, D., Libgober, B. et al. Data and methods for analyzing special interest influence in rulemaking.Int Groups Adv 9, 425–435 (2020). https://doi.org/10.1057/s41309-020-00094-w

Download citation

Keywords