Documentary analysis was used to compare three reports. A data extraction form was developed to record information on the decision problem addressed in each report, literature searching methods, the clinical effectiveness review, cost-effectiveness analysis, conclusions and issues of concern.
The decision problems and search strategies for the STAs differed from those reported in the TAR. Not all trials of clinical effectiveness included in the TAR were reported by manufacturers. The methods and assumptions used to assess the cost-effectiveness of the technologies were generally similar between reports, although only one common health economic comparison was presented across the three reports. The TAR supports the STA results for docetaxel but suggested that the manufacturer's cost-effectiveness estimates for paclitaxel were highly optimistic.
Although the STA process provides the opportunity for rapid appraisal of new technologies, there remains uncertainty concerning the extent to which STAs adequately address the specific decision problem under consideration.