Quality of Reporting of Randomized Clinical Trials in Tai Chi Interventions—A Systematic Review (original) (raw)
Abstract
Objectives. To evaluate the reporting quality of published randomized clinical trials (RCTs) in the Tai Chi literature following the publication of the CONSORT guidelines in 2001. Data Sources. The OVID MEDLINE and PUBMED databases. Review Methods. To survey the general characteristics of Tai Chi RCTs in the literature, we included any report if (i) it was an original report of the trial; (ii) its design was RCT; (iii) one of the treatments being tested was Tai Chi; and (iv) it was in English. In addition, we assessed the reporting quality of RCTs that were published between 2002 and 2007, using a modified CONSORT checklist of 40 items. The adequate description of Tai Chi interventions in these trials was examined against a 10-item checklist adapted from previous reviews. Results. The search yielded 31 Tai Chi RCTs published from 2002 to 2007 and only 11 for 1992–2001. Among trials published during 2002–2007, the most adequately reported criteria were related to background, participant eligibility and interpretation of the study results. Nonetheless, the most poorly reported items were associated with randomization allocation concealment, implementation of randomization and the definitions of period of recruitment and follow-up. In addition, only 23% of RCTs provided adequate details of Tai Chi intervention used in the trials. Conclusion. The findings in this review indicated that the reporting quality of Tai Chi intervention trials is sub-optimal. Substantial improvement is required to meet the CONSORT guidelines and allow assessment of the quality of evidence. We believe that not only investigators, but also journal editors, reviewers and funding agencies need to follow the CONSORT guidelines to improve the standards of research and strengthen the evidence base for Tai Chi and for complementary and alternative medicine.
1. Introduction
Randomized controlled trials (RCTs) are generally considered to have the highest level of credibility in determining efficacy of a new treatment, hence, a “gold standard” for evidence-based clinical practice. Many health care professionals make treatment decisions based on reports of RCTs published in peer-reviewed journals.
The randomization process in RCTs not only can control many known and unknown confounding factors, but can also eliminate some bias so that any differences in outcome can be reasonably attributed to the effect of the treatment being tested. Unfortunately, bias can still be introduced into RCTs especially when the trials were poorly conducted. In fact, systematic errors were found in many published RCTs which results in the overestimation of the efficacy of investigational treatments [1, 2]. To identify bias, to assess the validity of a study, and to inform decisions, scientific readers need and deserve to know details regarding the conduct of the trial. Therefore, it is crucial for investigators to specify the design, conduct and analysis in study reports for publication.
Understanding the importance of transparency in reporting clinical trails, an international team, including epidemiologists, statisticians and journal editors, developed the Consolidated Standards for Reporting Trials (CONSORT) statement in 1996 [3]. The statement has a checklist of items that should be included in a trial report along with a flowchart showing the path of trial participants from enrollment to analysis. The goal of the CONSORT statement was to facilitate critical appraisal and interpretation of RCTs by providing investigators a framework for improvement in reporting studies. In addition, journal reviewers can use the CONSORT statement to assist them in identifying reports with potentially biased results. In 2001, the CONSORT statement, the checklist and the flowchart have all been revised in response to pubic feedback. In addition, extensive explanation and elaboration were provided with the revised statement to make it easier for authors and editors to use [4].
Since its first introduction in 1996 and revision in 2001, CONSORT has been used to assess the reporting quality of RCTs testing different interventions, including pharmacology [5], surgery [6], weight loss [7] and acupuncture [8]. Nonetheless, little is known about the quality of reporting in randomized trials of Tai Chi interventions. Therefore, the primary objective of this review was to evaluate the completeness and transparency of Tai Chi trial reports published in peer-reviewed journals. More specifically, we were aiming to (i) describe the characteristics of published Tai Chi RCTs which can be found in MEDLINE between 1966 and 2007; (ii) identify problematic areas in reporting trials among Tai Chi RCTs published between January 2002 and December 2007, using a modified CONSORT checklist of 40 items; and (iii) examine the adequate description of Tai Chi interventions in trials published between January 2002 and December 2007 against a 10-item checklist adapted from previous reviews.
2. Methods
2.1. Trial Selection
In January 2008, we performed a MEDLINE (1966–2007) search via OVID using key words: Tai Chi; Taiji; T'ai Chi; randomized controlled trial; clinical Trial. In addition, we latter performed a similar search in PUBMED as suggested by the journal editor. To survey the characteristics of all published trials in the Tai Chi literature, we decided that a trial report would be included if it meets the following criteria: (i) the article was an original report of the trial; (ii) the study design was RCT. For this study, a RCT was defined as an experimental study in which study participants were randomly allocated to at least two groups to test the efficacy/effectiveness of interventions [9]; (iii) one of the treatments being tested was Tai Chi; and (iv) the publication was in English. Three authors, J. L., Y. Z. and J. F., then independently reviewed the abstracts and full articles (when necessary) to assess whether randomized trial reports identified in the literature search met our inclusion criteria. Discrepancies in this assessment were resolved through discussion and consensus. Lastly, among all the included Tai Chi RCTs, we identified those published between January 2002 and December 2007 to examine the quality of reporting of these trials.
2.2. Data Extraction
Since the CONSORT statement was not originally designed to be used as a quality assessment instrument, we made the following modification based on the 2001 version of the CONSORT statement.
First, some original items in CONSORT were rewritten so that multiple items were subdivided and listed separately to ensure only one response per item. For instance, item 1 in the original CONSORT statement relating to title and abstract: “How participants were allocated to intervention” was rewritten into two items as the following: (1-1) Does the title identify the report as a RCT? (1-2) Does the abstract have a structured format? This resulted in a checklist including 40 separate items (Table 1). Each item could be assigned a “yes” or “no” to indicate whether the component had been reported as recommended.
Table 1.
Reporting quality of randomized trials testing the efficacy of Tai Chi interventions, using a modified CONSORT checklist, for studies published between 2003 and 2007.
Paper section & topic | Item | Reporting criterion | Numbera (%) |
---|---|---|---|
Title & Abstract | 1-1 | Does the title identify the report as a RCT? | 20 (65) |
1-2 | Does the abstract have a structured format? | 27 (87) | |
Introduction | 2 | Do authors provide the scientific background and the scientific rationale for their report? | 31 (100) |
Background | |||
Methods | 3-1 | Are eligibility (inclusion and/or exclusion) criteria provided? | 31 (100) |
Participants | 3-2 | Do authors describe settings where the data were collected? | 9 (29) |
Interventionsb | 4 | Are the precise details of interventions described?b | 7 (23) |
Objectives | 5 | Are study objectives or hypotheses specified? | 29 (94) |
Outcomes | 6-1 | Are outcome variables clearly defined? | 28 (90) |
6-2 | Are any particular methods used to enhance the quality of the measurements? | 13 (42) | |
Sample size | 7-1 | Do authors explain how the sample size was determined? | 13 (42) |
7-2 | Is attrition taken into account in the sample size calculation? | 7 (54)c | |
Randomization: Sequence generation | 8-1 | Is there a description of the method used to generate the random allocation sequence? | 15 (48) |
8-2 | Is there any restriction of randomization provided? | 14 (45) | |
Randomization: Allocation concealment | 9-1 | Is the method used to implement the random allocation sequence described? | 5 (16) |
9-2 | Do authors clarify whether the sequence was concealed until interventions were assigned? | 9 (29) | |
Randomization: Implementation | 10-1 | Do authors report who generated the allocation sequence? | 8 (26) |
10-2 | Do authors report who enrolled participants? | 7 (23) | |
10-3 | Do authors report who assigned participants to their groups? | 7 (23) | |
Blinding (Masking) | 11 | Do author report whether or not outcome assessors were blinded to group assignment? | 14 (45) |
Statistical methods | 12 | Is there a description of the statistical methods used to compare groups for outcome variables? | 29 (94) |
Results | 13-1 | Is there a diagram showing participant flow in the trial? | 15 (48) |
Participant flow | 13-2 | Do authors report the numbers of participants randomly assigned? | 20 (65) |
13-3 | Do authors report the numbers of participants receiving intended treatment? | 12 (40) | |
13-4 | Do authors report the numbers of participants completing the study protocol? | 23 (74) | |
13-5 | Do authors report the numbers of participants analyzed for the primary outcome? | 16 (52) | |
Recruitment | 14-1 | Is the period of recruitment defined including starting and ending dates? | 7 (23) |
14-2 | Is the period of follow-up defined including starting and ending dates? | 3 (10) | |
Baseline data | 15 | Are baseline demographic and clinical characteristics of each group presented? | 28 (90) |
Numbers analyzed | 16-1 | Do authors report the numbers of participants in each group included in each analysis? | 19 (61) |
16-2 | Do author state that whether the analysis was by “intention-to-treat”? | 12 (39) | |
16-3 | Are the results presented in absolute numbers? | 23 (77) | |
Outcomes and estimation | 17-1 | Is there a summary of results for each group? | 28 (90) |
17-2 | For each outcome variable, is the estimated effect size reported? | 26 (84) | |
17-3 | For each outcome variable, is the effect size's precision (e.g., 95% confidence interval) reported? | 24 (77) | |
Ancillary analyses | 18 | Do authors report any other analyses performed including subgroup analyses and adjusted analyses, indicating those pre-specified and those exploratory? (e.g., adjusted P, post hoc or a posteriori) | 10 (32) |
Adverse events | 19 | Is there any information on adverse events in each intervention group provided? | 12 (39) |
Discussion | 20-1 | Do authors address study hypotheses/objectives in their interpretation of the results? | 30 (97) |
Interpretation | 20-2 | Do authors describe sources of potential bias or imprecision in their interpretation of the results? | 26 (84) |
Generalizability | 21 | Do authors discuss the generalizability (external validity) of the trial findings? | 14 (45) |
Overall evidence | 22 | Do authors discuss the results in the context of current evidence? | 17 (58) |
Second, item 4 in the original CONSORT statement is described as: “precise details of the interventions intended for each group and how and when they were actually administered”. This item is poorly defined and not readily applied to reporting Tai Chi interventions in a trial. In this review, we used a mini-checklist of 10 items to assess the adequate reporting of testing treatments in a Tai Chi study. If more than seven items in this mini checklist were reported by a trial, item 4 in the original CONSORT statement was considered satisfied. This mini-checklist was adapted from previous reviews [10, 11] and is shown in Table 2. We used this mini-checklist because there is no consensus in the literature in specifying Tai Chi interventions in a RCT. In addition, we believe that this checklist follows the guidelines for reporting non-pharmacologic treatments recommended by the CONSORT group [12].
Table 2.
Assessment of adequate details of Tai Chi interventions, using a mini-checklist adapted from previous reviews, for studies published between 2002 and 2007.
Reporting criterion | Numbera (%) |
---|---|
(1) How long was the intervention (weeks)? | 31 (100) |
(2) Was the Tai Chi training center-based or home-based or both? | 28 (90) |
(3) If it is center-based, how often was the Tai Chi training class per week and how long did a Tai Chi training class last (minutes)? | 28 (90) |
(4) What did a Tai Chi training session consist of in the study? Were there any other non-Tai Chi exercises included in a Tai Chi training session? | 2 (6) |
(5) What style of Tai Chi (Yang, Chen, Sun, etc.) was used in the intervention described? | 23 (74) |
(6) What were the major components (i.e. slow movements, mental concentration and deep breathing) of Tai Chi that were emphasized in the training? | 17 (55) |
(7)bWere specific Tai Chi movements used in the training described and illustrated? | 6 (19) |
(8) What were the credentials of the Tai Chi instructors in the study? | 12 (39) |
(9) Was the evaluation of the Tai Chi training and/or the instructor by study subjects available? | 2 (6) |
(10) Was the description of the control comparable to the description of the Tai Chi training? | 26 (84) |
One author J. L. reviewed full articles of included trials published between 2002 and 2007 to determine whether each of the 40 items in the modified checklist was reported. In addition, a second reviewer, Y. Z., independently checked a set of 10 articles (33% of all studies) selected using computer-generated “random” numbers. Before the evaluation process, J. L. and other authors studied and discussed the definition of each item in the revised CONSORT statement using the published guideline [4]. Furthermore, J. L. played a leading role in rewriting the checklist used in this review. Using the checklist, the authors evaluated five Tai Chi trials that were published before 2002 together, and then completed an independent evaluation of another three ineligible Tai Chi trials due to their publication date. The results were compared and discrepancies were resolved through discussion and consensus. The above process was to ensure that (i) the new checklist was workable and (ii) the single reviewer shared the same interpretation of the checklist with the other authors.
2.3. Statistics Analysis
We determined the proportion of RCTs reporting each of the 40 items in the modified CONSORT checklist and each of the 10 items in the mini-checklist. Only descriptive statistics were used. We did not calculate a total quality of reporting score (summing the dichotomized scores of the 40-item checklist) for each trial in this review, as the individual items on the checklist were not felt to share equal weight.
The second rater, Y. Z., reviewed 10 articles and decided whether each of the 40 items in the modified checklist was reported. After both raters finished their review, we calculated Cohen's _κ_-statistics to assess agreement between two reviewers. Good inter-reviewer agreement (κ = 0.8–1) was found for the majority (95%) of the CONSORT items. Fair agreement (κ = 0.6–0.8) was only found for two items (Item 3-2, which states: “Do authors describe settings where the data were collected?” and item 18, which states: “Do authors report who assigned participants to their groups?”). The disagreements were resolved by consensus between two raters.
3. Results
The MEDLINE search yielded total 41 [15–55] relevant Tai Chi randomized trials published from 1992 to 2007. The PUBMED search subsequently identified only one additional study [56]. This article was added to our final analysis. Among the 42 RCTs identified in the literature search, 31 [26–56] of them were published between 2002–2007 and only 11 [15–25] for 1992–2001. Figure 1 presents a flow chart of studies considered for inclusion.
Figure 1.
Flow chart of RCTs testing the efficacy of Tai Chi interventions included in this review.
3.1. The Characteristics of Published RCTs Involving Tai Chi between 1966 and 2007
3.1.1. Number of Published Studies
The first report of a RCT of Tai Chi was published in 1992. Since then, the overall number of published studies has been increasing over the years (Figure 2). A dramatic increase in the number of Tai Chi clinical trials is observed in the past 5 years. The number of Tai Chi reports nearly tripled, from only 11 trials in 1992–2001 to 31 trials published between 2002 and 2007.
Figure 2.
Number of published RCTs testing Tai Chi interventions.
3.2. Distribution of Journals
We found that slightly more than one fourth of the Tai Chi studies (11 trials) were published in the Journal of the American Geriatrics Society, while the rest of the trial reports were distributed evenly in 26 other various journals, including Evidenced Complementary & Alternative Medicine, Age and Ageing, Archives of Physical Medicine & Rehabilitation, and so forth.
3.2.1. Clinical Application of Tai Chi
We found that in the last two decades Tai Chi has been extensively tested for improving balance and preventing falls among older people. The main study outcome in 16 out of a total of 42 RCTs was associated with balance control, muscle strength and/or number of falls. Nonetheless, researchers were also looking into potential application of Tai Chi in other clinical areas, ranging from anti-hypertension to promotion of general fitness. A list of clinical applications that Tai Chi has been tested for in previous trials is presented in Table 3.
Table 3.
List of clinical applications that Tai Chi has been tested for in RCTs published between 1992 and 2007.
Clinical application | Number of trials (Reference numbers) |
---|---|
Balance improvement and fall prevention | 16 [16, 17, 20, 21, 25, 29, 32, 36, 39, 40, 43, 48, 50, 53–55] |
Osteoarthritis | 4 [23, 27, 46, 47] |
Quality of life among patients with chronic disease | 3 [33, 35, 42] |
Psychological health | 3 [15, 18, 44] |
Bone health | 2 [30, 51] |
Hypertension | 2 [22, 28] |
Immune health | 2 [26, 49] |
Heart failure | 2 [34, 45] |
Physical functions | 1 [24] |
Tension-type headaches | 1 [56] |
Sleep problems | 1 [31] |
Reduction in cardiovascular disease risk factors | 1 [37] |
Traumatic brain injury | 1 [41] |
Diabetes control | 1 [52] |
Rehabilitation following acute myocardial infarction | 1 [19] |
General fitness | 1 [38] |
3.3. The Reporting Quality of RCTs of Tai Chi Published between 2002 and 2007
A summary of the proportion of RCTs reporting each item in the modified CONSORT checklist is presented in Table 1. In general, the most adequately reported criteria were related to background (item 2), participant eligibility (item 3-1) and interpretation of the study results (item 20-1). In addition, the majority of the reports (90-95%) had well-defined study objectives (item 5) and outcome variables (item 6-1), provided adequate description of statistical methods (item 12), baseline characteristics of study participants (item 15) and a summary of results for study groups (item 17-1). On the other hand, the most poorly reported items were associated with allocation concealment and implementation of randomization (Item 9-1, 9-2, 10-1, 10-2, 10-3). In addition, less than one-fourth (23%) of the trials clearly defined the period of recruitment (item 14-1). Only three trials reported the period of follow-up of their studies (item 14-2). Finally, 23% of included trial reports were considered to provide adequate details of Tai Chi interventions in their studies, because they reported at least 7 out of 10 items in the mini checklist. The extent to which the mini-checklist criteria were met is presented in Tables 2 and 4. More detailedtablescontaining full references are available from the authors.
Table 4.
Distribution of Tai Chi clinical trials according to the number of items reported in the mini-checklist for specifying Tai Chi interventions.
Number of criteria reported | Number of articles (%) |
---|---|
10 | — |
9 | — |
8 | — |
7 | 7 (23) |
6 | 11 (35) |
5 | 9 (29) |
4 | 3 (10) |
3 | 1 (3) |
2 | — |
1 | — |
4. Discussion
In order to present their trials in an open and transparent manner, Tai Chi investigators need to follow the widely accepted CONSORT guidelines. It is important to address this issue for many reasons. First, poorly reported clinical trials make it difficult for other researchers to assess the validity of the results, to replicate the study, and to identify gaps that need to be addressed in the design and reporting of future Tai Chi trials [4]. In addition, inadequate reporting may mislead health-care providers in their treatment decisions for patients. Lastly, policy-makers depend on information provided in clinical trials to decide whether they should promote Tai Chi to a larger population.
Unfortunately, despite an increasing number of RCTs assessing Tai Chi in the past two decades, the reporting quality of these trials is sub-optimal and substantial improvement is required to meet the CONSORT guidelines. Almost 50% of the trials we reviewed did not satisfy more than half of the criteria in the modified CONSORT checklist and only 23% of RCTs provided adequate details of Tai Chi intervention used in the trials. Moreover, many of the poorly reported criteria have been associated with biased and erroneous interpretations of study findings. Each of these potentially problematic areas, including randomization, intention-to-treat analysis, masking, sample size and interventions is discussed below to help scientific readers recognize them when reviewing studies of Tai Chi.
4.1. Randomization
The results from a RCT are considered the most reliable form of scientific evidence because it involves the random allocation of different treatments to study participants. A well-conducted randomization procedure could not only prevent selection bias, but also control known and unknown confounders, thus ensuring the validity of the study results. Unfortunately, human interference could ruin a perfect randomization method and lead to biased and invalid findings. Therefore, the original CONSORT statement suggests that investigators should provide information regarding who performed randomization and whether allocation sequence was hidden from them, and also how the sequence was generated. This is to help readers assess whether the random assignments were unpredictable, and more importantly, to identify potential bias introduced by the study team. Unfortunately, we found less than half of the trial reports we reviewed provide a description of sequence generation. Reporting of the allocation concealment and randomization implementation was even worse. In more than two-third (70%) of the trials, it was not clear whether the person who allocated interventions knew the sequence or not. This leads a reader to question whether the randomization process was free from human alteration and, in turn, whether the findings were valid.
4.2. Intention-to-Treat Analysis
The goal of intention-to-treat analysis is to preserve the benefits of randomization by comparing patients in the treatment groups to which they were originally assigned, not on the treatment eventually administered. The randomization process in a RCT balances potential confounders. Nevertheless, if a confounder is associated with study participation and continuation, then omitting those who withdraw from a trial will reintroduce imbalance on this confounding factor. Thus, the benefit of randomization is compromised if intention-to-treat is not the primary analysis method. However, >60% of the Tai Chi RCTs did not mention the use of intention-to-treat analysis. Among them, 10 trials did not even document the numbers of participants in each group included in each analysis, making it very difficult to judge the validity of their findings.
4.3. Masking
The use of masking (blinding investigators/participants to treatment status) is aiming to reduce reporting and measurement bias [57]. In reality, it is not feasible to blind the study participants from the interventions assigned to them in a Tai Chi clinical trial. The investigators, however, could and should make every effort to mask the staff who measure outcomes from the group assignment to eliminate measurement bias. Nonetheless, 17 Tai Chi trials (55%) included in this review did not report any blinding effort. Therefore, it is reasonable to suspect that the results of these studies may be biased intentionally or unintentionally. In fact, it has been shown that, on average, RCTs that have not used appropriate levels of blinding show larger treatment effects than blinded trials [1].
4.4. Sample Size
Theoretically, investigators should have a large enough number of subjects in the trials to have a high power of detecting clinical significant difference between interventions, if there is a difference. Ethically, investigators have to have adequate sample size to justify enrolling participants. Unfortunately, more than half (18 studies) of the trials reviewed in the study did not indicate how the sample size was determined. When scientific readers review the results of these trials, they are not able to determine whether the non-significant findings are because Tai Chi was not effective or because the study was underpowered. In addition, even among 13 trials that justified their sample size, five of them did not include attrition in their power calculation. Therefore, these trials were doomed to be underpowered, since the loss of study participants is ubiquitous in RCTs.
4.5. Interventions
Ideally, the description of interventions in a clinical trial should provide enough details for other researchers to compare and replicate the treatments. In addition, adequate information regarding the interventions in a trial report could help clinicians to introduce the most effective and efficient treatments into practice [12]. Therefore, it is important for investigators to describe their interventions as clearly as possible. However, when one of the treatments used in a trial is Tai Chi, the investigators have to pay extra attention, mainly because Tai Chi has been recognized as a complex exercise with multiple components. Many of these components are hypothesized to be therapeutic, yet remain poorly understood [11, 58]. Therefore, the Tai Chi interventions emphasizing different components may have different impact on the estimate of the treatment effect [10]. In this review, we used a 10-item mini-checklist to assess the adequate reporting of Tai Chi interventions in the existing clinical trials. We found no trials that met all the criteria; the majority of the trials (35%) reported only 6 out of 10 items in the checklist. Therefore, many of the Tai Chi RCTs could not provide comprehensive details for the interventions being tested. This finding underscores the necessity of developing a guideline for future investigators to report the Tai Chi protocol used in clinical trials.
Our study also revealed other potentially problematic issues when reporting Tai Chi clinical trials. A participant flow chart is the most effective way to help readers to track the numbers of participants in different phases of a complex RCT. Only 48% of the RCTs we reviewed had a diagram showing participant flow. Since the flow charts play an essential role in understanding why some participants did not receive the intervention as assigned, withdrew from the study, or were not counted in the final analysis, the inclusion of the flow charts in reports about Tai Chi interventions is indispensible. In addition, reporting the periods of recruitment and follow-up, including starting and ending dates, was 23% and 10%, respectively in the Tai Chi clinical trials. Providing this information is useful for other researchers to know the rate at which participants were enrolled in Tai Chi studies, and whether a trial was stopped earlier than expected [4]. Lastly, adverse events have not been well documented in the previous Tai Chi trials; only 39% of the reports provided explicit information on adverse events. It is common that, during a clinical trial, study participants may report unintended or undesirable effects. Although these effects may or may not associate with the interventions, readers still deserve to know this information to weigh the risks and benefits of Tai Chi.
4.6. Limitations
We acknowledge some potential limitations of this review. First, we did not evaluate the reporting quality of Tai Chi clinical trials published before 2002. Previous studies [4, 57] have shown that the reporting quality of clinical trials for any disease treatment before the 1996 CONSORT statement was extremely poor and that the publication of CONSORT guidelines was associated with improved reporting quality in studies published in journals both using and not using the CONSORT statement [4, 59]. In fact, we found that the average number of items reported in the modified CONSORT checklist is 16.7, 21.8 and 22.0 for trial reports published during 1992–1996, 1997–2001 and 2002–2007, respectively. The poor quality of reporting for Tai Chi trials published between 1992 and 1996 may due to the fact that the CONSORT guidelines were not available to the authors of these trial reports. Therefore, we decided it was only informative to review the Tai Chi trials published after 2002, one year after the publication of the 2001 CONSORT guidelines, since the purpose of our study was to determine how well the Tai Chi RCTs met the new guidelines. Prior to 2002, researchers did not have the strict guidelines for guidance on how to describe their procedures. Second, we only included Tai Chi trial reports found in PUBMED and MEDLINE to ensure that all articles included have undergone similar peer and editorial review ensuring quality control. However, it is important to recognize that Tai Chi studies reported in foreign languages make up a part of Tai Chi literature with an unknown significance. Including foreign language publications may be necessary when the goal of a review is to estimate the effectiveness of Tai Chi interventions. Nevertheless, the primary objective of this article was to evaluate the completeness and transparency of Tai Chi trial reports in the literature and not to evaluate the effectiveness/efficacy of Tai Chi interventions.
Tai Chi trial reports are certainly increasing over the years and play an essential role in determining the efficacy and effectiveness of Tai Chi interventions. While we recognize that the RCTs may not constitute the largest proportion of the Tai Chi literature, they are the “gold standard” by which treatment effectiveness is evaluated. Therefore, we decided to focus this review on reports of randomized trials. Lastly, our two reviewers were not blinded to authorship, journal title and other study-related information because it has been shown that masking has little impact on the conclusions of a systematic review [60, 61]. In addition, it was almost impossible to be totally blind, as this would have meant reformatting all 31 articles included to mask any mention of the author's work.
5. Conclusion
As the editors of the Journal o the American Medical Association, Drs. Fontanarosa and Lundberg pointed out in their editorial on alternative medicine in 1998 [62], properly designed and conducted randomized controlled trials are needed to provide solid scientific evidence regarding the safety, efficacy and effectiveness of complimentary and alternative medicine (CAM) interventions. As the number of clinical trials testing CAM interventions is increasing, attention needs to be given to the quality of reporting of clinical trials. Without complete and adequate reporting, it is impossible to assess the methodological rigor of the study, and in turn, the scientific evidence of the CAM intervention being tested. We believe that following the CONSORT guidelines will improve the quality of reporting of a RCT. The essential component of CONSORT is transparency of reporting the design, execution and findings of a study, a principle that should apply equally to other types of research. We also believe that not only investigators but also journal editors, reviewers and funding agencies need to follow the CONSORT clinical trial reporting guidelines to improve the standards of research and the strength of the evidence base for Tai Chi and other research.
References
- 1.Schulz KF, Chalmers L, Hayes RJ, Altman DG. Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials. Journal of the American Medical Association. 1995;273(5):408–412. doi: 10.1001/jama.273.5.408. [DOI] [PubMed] [Google Scholar]
- 2.Moher D, Pham B, Jones A, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? The Lancet. 1998;352(9128):609–613. doi: 10.1016/S0140-6736(98)01085-X. [DOI] [PubMed] [Google Scholar]
- 3.Begg C, Cho M, Eastwood S, et al. Improving the quality of reporting of randomized controlled trials: the CONSORT statement. Journal of the American Medical Association. 1996;276(8):637–639. doi: 10.1001/jama.276.8.637. [DOI] [PubMed] [Google Scholar]
- 4.Moher D, Altman DG, Schulz KF, et al. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Annals of Internal Medicine. 2001;134(8):663–694. doi: 10.7326/0003-4819-134-8-200104170-00012. [DOI] [PubMed] [Google Scholar]
- 5.Mills E, Loke YK, Wu P, et al. Determining the reporting quality of RCTs in clinical pharmacology. British Journal of Clinical Pharmacology. 2004;58(1):61–65. doi: 10.1111/j.1365-2125.2004.2092.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Selman TJ, Johnson NP, Zamora J, Khan KS. Gynaecologic surgery from uncertainty to science: evolution of randomized control trials. Human Reproduction. 2008;23(4):827–831. doi: 10.1093/humrep/dem422. [DOI] [PubMed] [Google Scholar]
- 7.Thabane L, Chu R, Cuddy K, Douketis J. What is the quality of reporting in weight loss intervention studies? A systematic review of randomized controlled trials. International Journal of Obesity. 2007;31(10):1554–1559. doi: 10.1038/sj.ijo.0803640. [DOI] [PubMed] [Google Scholar]
- 8.Prady SL, Richmond SJ, Morton VM, MacPherson H. A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS ONE. 2008;3(2) doi: 10.1371/journal.pone.0001577. Article ID e1577. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Hulley SB, Cummings SR, Browner WS, Grady D, Hearst N, Newman TB. Designing Clinical Research. Philadelphia, Pa, USA: Lippincott Williams and Wilkins; 2001. [Google Scholar]
- 10.Wu G. Evaluation of the effectiveness of Tai Chi for improving balance and preventing falls in the older population—a review. Journal of the American Geriatrics Society. 2002;50(4):746–754. doi: 10.1046/j.1532-5415.2002.50173.x. [DOI] [PubMed] [Google Scholar]
- 11.Wayne PM, Kaptchuk TJ. Challenges inherent to t’ai chi research: part II—defining the intervention and optimal study design. Journal of Alternative and Complementary Medicine. 2008;14(2):191–197. doi: 10.1089/acm.2007.7170b. [DOI] [PubMed] [Google Scholar]
- 12.Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Annals of Internal Medicine. 2008;148(4):295–309. doi: 10.7326/0003-4819-148-4-200802190-00008. [DOI] [PubMed] [Google Scholar]
- 13.Chinese Sports Editorial Board. Simplified Taijiquan. 3rd edition. Beijing, China: Foreign Languages Printing House; 1986. [Google Scholar]
- 14.Wolf SL, Coogler C, Xu T. Exploring the basis for Tai Chi Chuan as a therapeutic exercise approach. Archives of Physical Medicine and Rehabilitation. 1997;78(8):886–892. doi: 10.1016/s0003-9993(97)90206-9. [DOI] [PubMed] [Google Scholar]
- 15.Jin P. Efficacy of Tai Chi, brisk walking, meditation, and reading in reducing mental and emotional stress. Journal of Psychosomatic Research. 1992;36(4):361–370. doi: 10.1016/0022-3999(92)90072-a. [DOI] [PubMed] [Google Scholar]
- 16.Judge JO, Lindsey C, Underwood M, Winsemius D, Keshner EA. Balance improvements in older women: effects of exercise training. Physical Therapy. 1993;73(4):254–265. doi: 10.1093/ptj/73.4.254. [DOI] [PubMed] [Google Scholar]
- 17.Wolf SL, Kutner NG, Green RC, McNeely E. The Atlanta FICSIT study: two exercise interventions to reduce frailty in elders. Journal of the American Geriatrics Society. 1993;41(3):329–332. doi: 10.1111/j.1532-5415.1993.tb06713.x. [DOI] [PubMed] [Google Scholar]
- 18.Brown DR, Wang Y, Ward A, et al. Chronic psychological effects of exercise and exercise plus cognitive strategies. Medicine and Science in Sports and Exercise. 1995;27(5):765–775. [PubMed] [Google Scholar]
- 19.Channer KS, Barrow D, Barrow R, Osborne M, Ives G. Changes in haemodynamic parameters following Tai Chi Chuan and aerobic exercise in patients recovering from acute myocardial infarction. Postgraduate Medical Journal. 1996;72(848):349–351. doi: 10.1136/pgmj.72.848.349. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Wolf SL, Barnhart HX, Kutner NG, McNeely E, Coogler C, Xu T. Reducing frailty and falls in older persons: an investigation of Tai Chi and computerized balance training. Atlanta FICSIT group. Frailty and injuries: cooperative studies of intervention techniques. Journal of the American Geriatrics Society. 1996;44(5):489–497. doi: 10.1111/j.1532-5415.1996.tb01432.x. [DOI] [PubMed] [Google Scholar]
- 21.Wolfson L, Whipple R, Derby C, et al. Balance and strength training in older adults: intervention gains and Tai Chi maintenance. Journal of the American Geriatrics Society. 1996;44(5):498–506. doi: 10.1111/j.1532-5415.1996.tb01433.x. [DOI] [PubMed] [Google Scholar]
- 22.Young DR, Appel LJ, Jee S, Miller ER., III The effects of aerobic exercise and T’ai Chi on blood pressure in older people: results of a randomized trial. Journal of the American Geriatrics Society. 1999;47(3):277–284. doi: 10.1111/j.1532-5415.1999.tb02989.x. [DOI] [PubMed] [Google Scholar]
- 23.Hartman CA, Manos TM, Winter C, Hartman DM, Li B, Smith JC. Effects of T’ai Chi training on function and quality of life indicators in older adults with osteoarthritis. Journal of the American Geriatrics Society. 2000;48(12):1553–1559. doi: 10.1111/j.1532-5415.2000.tb03863.x. [DOI] [PubMed] [Google Scholar]
- 24.Li F, Harmer P, McAuley E, et al. An evaluation of the effects of Tai Chi exercise on physical function among older persons: a randomized controlled trial. Annals of Behavioral Medicine. 2001;23(2):139–146. doi: 10.1207/S15324796ABM2302_9. [DOI] [PubMed] [Google Scholar]
- 25.Nowalk MP, Prendergast JM, Bayles CM, D’Amico FJ, Colvin GC. A randomized trial of exercise programs among older individuals living in two long-term care facilities: the fallsFREE program. Journal of the American Geriatrics Society. 2001;49(7):859–865. doi: 10.1046/j.1532-5415.2001.49174.x. [DOI] [PubMed] [Google Scholar]
- 26.Irwin MR, Pike JL, Cole JC, Oxman MN. Effects of a behavioral intervention, Tai Chi Chih, on varicella-zoster virus specific immunity and health functioning in older adults. Psychosomatic Medicine. 2003;65(5):824–830. doi: 10.1097/01.psy.0000088591.86103.8f. [DOI] [PubMed] [Google Scholar]
- 27.Song R, Lee E-O, Lam P, Bae S-C. Effects of Tai Chi exercise on pain, balance, muscle strength, and perceived difficulties in physical functioning in older women with osteoarthritis: a randomized clinical trial. Journal of Rheumatology. 2003;30(9):2039–2044. [PubMed] [Google Scholar]
- 28.Tsai J-C, Wang W-H, Chan P, et al. The beneficial effects of Tai Chi chuan on blood pressure and lipid profile and anxiety status in a randomized controlled trial. Journal of Alternative and Complementary Medicine. 2003;9(5):747–754. doi: 10.1089/107555303322524599. [DOI] [PubMed] [Google Scholar]
- 29.Wolf SL, Sattin RW, Kutner M, O’Grady M, Greenspan AI, Gregor RJ. Intense Tai Chi exercise training and fall occurrences in older, transitionally frail adults: a randomized, controlled trial. Journal of the American Geriatrics Society. 2003;51(12):1693–1701. doi: 10.1046/j.1532-5415.2003.51552.x. [DOI] [PubMed] [Google Scholar]
- 30.Chan K, Qin L, Lau M, et al. A randomized, prospective study of the effects of Tai Chi Chun exercise on bone mineral density in postmenopausal women. Archives of Physical Medicine and Rehabilitation. 2004;85:717–722. doi: 10.1016/j.apmr.2003.08.091. [DOI] [PubMed] [Google Scholar]
- 31.Li F, Fisher KJ, Harmer P, Irbe D, Tearse RG, Weimer C. Tai Chi and self-rated quality of sleep and daytime sleepiness in older adults: a randomized controlled trial. Journal of the American Geriatrics Society. 2004;52(6):892–900. doi: 10.1111/j.1532-5415.2004.52255.x. [DOI] [PubMed] [Google Scholar]
- 32.McGibbon CA, Krebs DE, Wolf SL, Wayne PM, Scarborough DM, Parker SW. Tai Chi and vestibular rehabilitation effects on gaze and whole-body stability. Journal of Vestibular Research. 2004;14(6):467–478. [PubMed] [Google Scholar]
- 33.Mustian KM, Katula JA, Gill DL, Roscoe JA, Lang D, Murphy K. Tai Chi Chuan, health-related quality of life and self-esteem: a randomized trial with breast cancer survivors. Supportive Care in Cancer. 2004;12(12):871–876. doi: 10.1007/s00520-004-0682-6. [DOI] [PubMed] [Google Scholar]
- 34.Yeh GY, Wood MJ, Lorell BH, et al. Effects of Tai Chi mind-body movement therapy on functional status and exercise capacity in patients with chronic heart failure: a randomized controlled trial. American Journal of Medicine. 2004;117(8):541–548. doi: 10.1016/j.amjmed.2004.04.016. [DOI] [PubMed] [Google Scholar]
- 35.Galantino ML, Shepard K, Krafft L, et al. The effect of group aerobic exercise and T'ai Chi on functional outcomes and quality of life for persons living with acquired immunodeficiency syndrome. Journal of Alternative and Complementary Medicine. 2005;11(6):1085–1092. doi: 10.1089/acm.2005.11.1085. [DOI] [PubMed] [Google Scholar]
- 36.Li F, Harmer P, Fisher KJ, et al. Tai Chi and fall reductions in older adults: a randomized controlled trial. Journals of Gerontology—Series A. 2005;60(2):187–194. doi: 10.1093/gerona/60.2.187. [DOI] [PubMed] [Google Scholar]
- 37.Thomas GN, Hong AWL, Tomlinson B, et al. Effects of Tai Chi and resistance training on cardiovascular risk factors in elderly Chinese subjects: a 12-month longitudinal, randomized, controlled intervention study. Clinical Endocrinology. 2005;63(6):663–669. doi: 10.1111/j.1365-2265.2005.02398.x. [DOI] [PubMed] [Google Scholar]
- 38.Audette JF, Jin YS, Newcomer R, Stein L, Duncan G, Frontera WR. Tai Chi versus brisk walking in elderly women. Age and Ageing. 2006;35(4):388–393. doi: 10.1093/ageing/afl006. [DOI] [PubMed] [Google Scholar]
- 39.Faber MJ, Bosscher RJ, Chin A Paw MJ, van Wieringen PC. Effects of exercise programs on falls and mobility in frail and pre-frail older adults: a multicenter randomized controlled trial. Archives of Physical Medicine and Rehabilitation. 2006;87(7):885–896. doi: 10.1016/j.apmr.2006.04.005. [DOI] [PubMed] [Google Scholar]
- 40.Gatts SK, Woollacott MH. Neural mechanisms underlying balance improvement with short term Tai Chi training. Aging. 2006;18(1):7–19. doi: 10.1007/BF03324635. [DOI] [PubMed] [Google Scholar]
- 41.Gemmell C, Leathem JM. A study investigating the effects of Tai Chi Chuan: individuals with traumatic brain injury compared to controls. Brain Injury. 2006;20(2):151–156. doi: 10.1080/02699050500442998. [DOI] [PubMed] [Google Scholar]
- 42.Mustian KM, Katula JA, Zhao H. A pilot study to assess the influence of Tai Chi Chuan on functional capacity among breast cancer survivors. Journal of Supportive Oncology. 2006;4(3):139–145. [PubMed] [Google Scholar]
- 43.Nnodim JO, Strasburg D, Nabozny M, et al. Dynamic balance and stepping versus tai chi training to improve balance and stepping in at-risk older adults. Journal of the American Geriatrics Society. 2006;54(12):1825–1831. doi: 10.1111/j.1532-5415.2006.00971.x. [DOI] [PubMed] [Google Scholar]
- 44.Robins JLW, McCain NL, Gray DP, Elswick RK, Jr., Walter JM, McDade E. Research on psychoneuroimmunology: Tai Chi as a stress management approach for individuals with HIV disease. Applied Nursing Research. 2006;19(1):2–9. doi: 10.1016/j.apnr.2005.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Barrow DE, Bedford A, Ives G, O'Toole L, Channer KS. An evaluation of the effects of Tai Chi Chuan and Chi Kung training in patients with symptomatic heart failure: a randomised controlled pilot study. Postgraduate Medical Journal. 2007;83(985):717–721. doi: 10.1136/pgmj.2007.061267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Brismée J-M, Paige RL, Chyu M-C, et al. Group and home-based Tai Chi in elderly subjects with knee osteoarthritis: a randomized controlled trial. Clinical Rehabilitation. 2007;21(2):99–111. doi: 10.1177/0269215506070505. [DOI] [PubMed] [Google Scholar]
- 47.Fransen M, Nairn L, Winstanley J, Lam P, Edmonds J. Physical activity for osteoarthritis management: a randomized controlled clinical trial evaluating hydrotherapy or Tai Chi classes. Arthritis Care and Research. 2007;57(3):407–414. doi: 10.1002/art.22621. [DOI] [PubMed] [Google Scholar]
- 48.Gatts SK, Woollacott MH. How Tai Chi improves balance: biomechanics of recovery to a walking slip in impaired seniors. Gait and Posture. 2007;25(2):205–214. doi: 10.1016/j.gaitpost.2006.03.011. [DOI] [PubMed] [Google Scholar]
- 49.Irwin MR, Olmstead R, Oxman MN. Augmenting immune responses to varicella zoster virus in older adults: a randomized, controlled trial of Tai Chi. Journal of the American Geriatrics Society. 2007;55(4):511–517. doi: 10.1111/j.1532-5415.2007.01109.x. [DOI] [PubMed] [Google Scholar]
- 50.Maciaszek J, Osiński W, Szeklicki R, Stemplewski R. Effect of Tai Chi on body balance: randomized controlled trial in men with osteopenia or osteoporosis. American Journal of Chinese Medicine. 2007;35(1):1–9. doi: 10.1142/S0192415X07004564. [DOI] [PubMed] [Google Scholar]
- 51.Shen C-L, Williams JS, Chyu M-C, et al. Comparison of the effects of Tai Chi and resistance training on bone metabolism in the elderly: a feasibility study. American Journal of Chinese Medicine. 2007;35(3):369–381. doi: 10.1142/S0192415X07004898. [DOI] [PubMed] [Google Scholar]
- 52.Tsang T, Orr R, Lam P, Comino EJ, Singh MF. Health benefits of Tai Chi for older patients with type 2 diabetes: the “Move It for Diabetes study”—a randomized controlled trial. Clinical Interventions in Aging. 2007;2(3):429–439. [PMC free article] [PubMed] [Google Scholar]
- 53.Voukelatos A, Cumming RG, Lord SR, Rissel C. A randomized, controlled trial of Tai Chi for the prevention of falls: the central sydney Tai Chi trial. Journal of the American Geriatrics Society. 2007;55(8):1185–1191. doi: 10.1111/j.1532-5415.2007.01244.x. [DOI] [PubMed] [Google Scholar]
- 54.Woo J, Hong A, Lau E, Lynn H. A randomised controlled trial of Tai Chi and resistance exercise on bone health, muscle strength and balance in community-living elderly people. Age and Ageing. 2007;36(3):262–268. doi: 10.1093/ageing/afm005. [DOI] [PubMed] [Google Scholar]
- 55.Yang Y, Verkuilen JV, Rosengren KS, Grubisich SA, Reed MR, Hsiao-Wecksler ET. Effect of combined Taiji and Qigong training on balance mechanisms: a randomized controlled trial of older adults. Medical Science Monitor. 2007;13(8):CR339–CR348. [PubMed] [Google Scholar]
- 56.Abbott RB, Hui K-K, Hays RD, Li M-D, Pan T. A randomized controlled trial of Tai Chi for tension headaches. Evidence-Based Complementary and Alternative Medicine. 2007;4(1):107–113. doi: 10.1093/ecam/nel050. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Moher D, Schulz KF, Altman D, et al. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. Journal of the American Medical Association. 2001;285(15):1987–1991. doi: 10.1001/jama.285.15.1987. [DOI] [PubMed] [Google Scholar]
- 58.Wayne PM, Kaptchuk TJ. Challenges inherent to T’ai Chi research: part I—T’ai Chi as a complex multicomponent intervention. Journal of Alternative and Complementary Medicine. 2008;14(1):95–102. doi: 10.1089/acm.2007.7170a. [DOI] [PubMed] [Google Scholar]
- 59.Plint AC, Moher D, Morrison A, et al. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Medical Journal of Australia. 2006;185(5):263–267. doi: 10.5694/j.1326-5377.2006.tb00557.x. [DOI] [PubMed] [Google Scholar]
- 60.Berlin JA. Does blinding of readers affect the results of meta-analyses? University of Pennsylvania meta-analysis blinding study group. The Lancet. 1997;350(9072):185–186. doi: 10.1016/s0140-6736(05)62352-5. [DOI] [PubMed] [Google Scholar]
- 61.Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Controlled Clinical Trials. 1996;17(1):1–12. doi: 10.1016/0197-2456(95)00134-4. [DOI] [PubMed] [Google Scholar]
- 62.Fontanarosa PB, Lundberg GD. Alternative medicine meets science. Journal of the American Medical Association. 1998;280(18):1618–1619. doi: 10.1001/jama.280.18.1618. [DOI] [PubMed] [Google Scholar]