Statistics Notes: Measurement error proportional to the mean (original) (raw)

  1. J Martin Bland, professor of medical statisticsa,
  2. Douglas G Altman, headb
  3. a Department of Public Health Sciences, St George's Hospital Medical School, London SW17 0RE
  4. b ICRF Medical Statistics Group, Centre for Statistics in Medicine, Institute of Health Sciences, PO Box 777, Oxford OX3 7LF
  5. Correspondence to: Professor Bland.

We often need to know the error with which measurements are made—for example, so that we can decide whether the change in a clinical observation represents a real change in a patient's condition. We have discussed previously the within-subject standard deviation as a practical index of measurement error.1 We said that this approach should be used when the measurement error was not related to the magnitude of the measurement and recommended that we plot the subject standard deviation against the subject mean to check this. Table 1 shows some duplicate salivary cotinine measurements taken from a larger study. Figure 1 shows absolute subject difference against subject mean, which is equivalent to a standard deviation versus mean plot when we have only two measurements per subject.1 If we are to use the within-subject standard deviation as an index of measurement error we need the subject standard deviation to be independent of the subject mean. Here, there is a clear relationship, the variability increasing with the magnitude. We can test this using a rank correlation coefficient if we wish; here Kendall's (tau) = 0.62, P = 0.0001. Under these circumstances a logarithmic transformation of the data almost always solves the problem, but we can check by plotting log standard deviation against log mean. For these data the slope is 0.9; as this is very close to 1 the subject standard deviation is roughly proportional to the subject mean and a log transformation is indicated.2 Figure 2 shows the plot of absolute difference versus subject mean for the log transformed data. There is now no evidence of a relationship (Kendall's (tau) = 0.07, P = 0.7).

Table 1

Duplicate salivary cotinine measurements for a group of Scottish schoolchildren (ng/ml) (D Strachan, personal communication

As the variability is now independent of the magnitude of the measurement, we can calculate the within-subject standard deviation1 as (sigma)w = 0.175. This is a standard deviation on the logarithmic scale, so we need to antilog it before we can interpret it easily. We will denote the antilog of (sigma)w by (alpha)(sigmaw). For the cotinine data, (alpha)(sigmaw) = 1.496.

When we antilog (sigma)w we have a ratio, not a quantity measured in the units of the original data. This is because to calculate a standard deviation we subtract the mean from each observation. Subtracting on the logarithmic scale is equivalent to dividing on the natural scale.3 Dividing the observation by the mean in this way produces a dimensionless ratio. Hence (alpha)(sigmaw) is not a standard deviation in the original units, but a related quantity sometimes referred to as the geometric standard deviation.

To estimate one standard deviation on either side of the observed value, we should multiply and divide by (alpha)(sigmaw). The difference between a subject's measurement and the true value would be expected to be less than 1.96(sigma)w for 95% of observations.1 To get the equivalent of 1.96 log scale standard deviations on either side of an observed value we would multiply and divide on the natural scale by (alpha)1.96(sigmaw) or approximately (alpha)2(sigmaw). This procedure gives limits which should include the subject's mean for 95% of observations. Thus for the cotinine data we would divide and multiply by 1.4962 = 2.238. A measurement of 2 ng/ml would tell us that the person's true value probably lies somewhere between 2/2.238 = 0.9 and 2 × 2.238 = 4.5 ng/ml.

Multiplying on the natural scale is equivalent to adding on the log scale. Multiplying a subject's actual measurement by (alpha)(sigmaw) is equivalent to adding one standard deviation on the log scale. Provided the standard deviation is not large compared with the level of the measurement, (alpha)(sigmaw)-1 is approximately equal to the standard deviation expressed as a proportion of the measurement. The ratio of standard deviation to mean is called a coefficient of variation, and here (alpha)(sigmaw)-1 is the within-subject coefficient of variation.

For the cotinine data the estimated coefficient of variation is 1.496-1 = 0.496 or 49.6%. This is rather too large for the approximation to be reliable.

The within-subject variability for salivary cotinine seems very large, but the possible range of values, from these very lightly exposed children to heavy smokers, is very wide and salivary cotinine is sufficiently precise to distinguish between many different levels of exposure. The precision of a method of measurement must be interpreted in the light of its intended use.