On the measurability of information quality (original) (raw)
Related papers
Research About Measurability of Information Quality
This article will discuss ongoing research about Information Quality (IQ). Raters evaluating various IQ dimensions (accuracy, completeness, objectivity ...) of same object showed low agreement level, therefore making IQ not measurable. Increase of IQ measurability to sufficient level would present an opportunity for guidelines to replace information of low with high quality. Speculations why IQ dimensions are not measurable have been made but at the same time mechanisms that improve agreement level have been proposed by researchers for validation. Moreover context in which information is being evaluated has not been yet addressed by existing research. This article will describe and explain a study that aims to create a robust model that will validate and measure effect of three different IQ aspects. Although this article is still work in progress, current results regarding research construction and preliminary testing will be presented as well as future steps.
Heuristic Principles and Differential Judgments in the Assessment of Information Quality
Journal of the Association for Information Systems, 2017
Information quality (IQ) is a multidimensional construct and includes dimensions such as accuracy, completeness, objectivity, and representation that are difficult to measure. Recently, research has shown that independent assessors who rated IQ yielded high inter-rater agreement for some information quality dimensions as opposed to others. In this paper, we explore the reasons that underlie the differences in the "measurability" of IQ. Employing Gigerenzer's "building blocks" framework, we conjecture that the feasibility of using a set of heuristic principles consistently when assessing different dimensions of IQ is a key factor driving inter-rater agreement in IQ judgments. We report on two studies. In the first study, we qualitatively explored the manner in which participants applied the heuristic principles of search rules, stopping rules, and decision rules in assessing the IQ dimensions of accuracy, completeness, objectivity, and representation. In the second study, we investigated the extent to which participants could reach an agreement in rating the quality of Wikipedia articles along these dimensions. Our findings show an alignment between the consistent application of heuristic principles and inter-rater agreement levels found on particular dimensions of IQ judgments. Specifically, on the dimensions of completeness and representation, assessors applied the heuristic principles consistently and tended to agree in their ratings, whereas, on the dimensions of accuracy and objectivity, they not apply the heuristic principles in a uniform manner and inter-rater agreement was relatively low. We discuss our findings implications for research and practice.
A Conceptual Framework and Belief Function Approach to Assessing Overall Information Quality
2001
We develop an information quality model based on a user-centric view adapted from Financial Accounting Standards Board 1 , Wang et al. 2 , and Wang and Strong 3 . The model consists of four essential attributes (or assertions): 'Accessibility,' 'Interpretability,' 'Relevance,' and 'Integrity.' Four sub-attributes lead to an evaluation of Integrity: 'Accuracy,' 'Completeness,' 'Consistency,' and 'Existence.' These sub-attributes relating to 'Integrity' are intrinsic in nature and relate to the process of how the information was created while the first three attributes: 'Accessibility,' 'Interpretability,' and 'Relevance' are extrinsic in nature. We present our model as an evidential network under the belief-function framework to permit user assessment of quality parameters. Two algorithms for combining assessments into an overall IQ measure are explored, and examples in the domain of medical information are used to illustrate key concepts. We discuss two scenarios, 'online-user' and 'assurance-provider,' which reflect two likely and important aspects of IQ evaluation currently facing information users -concerns about the impact of poor quality online information, and the need for information quality assurance.
Information quality: Purpose and dimensions
In this article I examine the problem of categorising dimensions of information quality (IQ), against the background of a serious engagement with the hypothesis that IQ is purposedependent. First, I examine some attempts to offer categories for IQ, and a specific problem that impedes convergence in such categorisations is diagnosed. Based on this new understanding, I suggest a new way of categorising both IQ dimensions and the metrics used in implementation of IQ improvement programmes according to what they are properties of. I conclude the paper by outlining an initial categorisation of some IQ dimensions and metrics in standard use to illustrate the value of the approach.
Assessment methods for information quality criteria
2000
Information quality (IQ) is one of the most important aspects of information integration on the Internet. Many projects realize and address this fact by gathering and classifying IQ criteria. Hardly ever do the projects address the immense difficulty of assessing scores for the criteria. This task must precede any usage of criteria for qualifying and integrating information. After reviewing previous attempts to classify IQ criteria, in this paper we also classify criteria, but in a new, assessment-oriented way. We identify three sources for IQ scores and thus, three IQ criterion classes, each with different general assessment possibilities. Additionally, for each criterion we give detailed assessment methods. Finally, we consider confidence measures for these methods. Confidence expresses the accuracy, lastingness, and credibility of the individual assessment methods.
AIMQ: a methodology for information quality assessment
Information & Management, 2002
Information Quality (IQ) is critical in organizations. Yet, despite a decade of active research and practice, the field lacks comprehensive methodologies for its assessment and improvement.
Are Importance Ratings Stable? A Study of Perceptions of Information Quality
Journal of the Midwest Association for Information Systems
Information consumption in China occurs in a rapidly shifting social and political environment. Understanding this group of information consumers is likely to play an important role in business and political decision making globally for the foreseeable future. Ratings of the importance of the dimensions of information quality and the way in which these ratings have shifted over time shed light on the beliefs of this group of information consumers. This study reports the results of a nonpanel longitudinal study involving two surveys conducted in China over a five year period examining information consumer ratings of the importance of the dimensions of information quality. Results show that Chinese information consumers rate the information quality dimensions of believability, reputation, and value-added as less important at the end of the five year period than at the beginning and rate representational consistency and concise representation as more important at the end of the five year period than at the beginning.
International Journal of Quality & Reliability …, 2003
The primary concern of quality improvement in professional services is not the input-output conversion, but the information that enables and controls action. The quality of information, however, remains a vaguely de®ned concept. Actionable information is here de®ned as meaning derived from data and context with a knowledge function. Standard de®nitions of quality are elaborated to make them applicable to information: closed system technical quality and open system negotiated quality are postulated as ideal types. This construct is used to de®ne information quality and suggest guidelines for methodology development.