The two new studies reconstructed the Lancet review and the main conclusions of that reconstruction are:
That the results of the Lancet review were very sensitive to the definition of 'large' trials.
The background to the ongoing debate is as follows:
In August 2005, the Lancet published an editorial entitled 'The End of Homeopathy', prompted by a review comparing clinical trials of homeopathy with trials of conventional medicine. The claim that homeopathic medicines are just placebo was based on 6 clinical trials of conventional medicine and 8 studies of homeopathy but did not reveal the identity of these trials. The review was criticised for its opacity as it gave no indication of which trials were analysed or the various assumptions made about the data.
Sufficient detail to enable a reconstruction was eventually provided and these two new studies are based on such a reconstruction and challenge the Lancet review. Specifically these two studies show:
- Analysis of all high quality trials of homeopathy yields a positive conclusion.
- The 8 larger higher quality trials of homeopathy were all for different conditions. Homeopathy works for some of these but not others, implying that homeopathy is not placebo.
- The comparison with conventional medicine was meaningless.
- Doubts remain about the opaque, unpublished criteria used in the review, including the definition of 'higher quality'.
Due to a lack of funding, there are a limited number of homeopathic studies. As a result, it is quite possible to interpret homeopathic data selectively and unfavourably, which is what appears to have been done in the Lancet paper. If we assume that homeopathy does not work for just one condition (Arnica for post-exercise muscle stiffness), or alter the definition of 'larger trial', the results are positive. The comparison with conventional medicine was meaningless: the original 110 trials were matched, but matching was lost after the trials were reduced to 8 in one group and 6 in the other. Interestingly, the quality of homeopathic trials was better than conventional trials.
This reconstruction casts serious doubts on the Lancet review, showing that it was based on a series of hidden judgments unfavourable to homeopathy. An open assessment of the current evidence suggests that homeopathy is probably effective for a number of conditions including allergies, upper respiratory tract infections and 'flu, but more research is desperately needed.
Prof Egger has declined to comment on these findings.
Lüdtke R, Rutten ALB. The conclusions on the effectiveness of homeopathy highly depend on the set of analyzed trials. J Clin Epidemiol 2008. doi:10.1016/j.jclinepi.2008.06.015 Rutten ALB, Stolper CF. The 2005 meta-analysis of homeopathy: the importance of post-publication data. Homeopathy 2008. doi:10.1016/j.homp.2008.09.008.
Source: Peter Gold
National Center for Homeopathy