MEDLINE and EMBASE databases were searched through June 31, 2013. Studies that used both a case-only (case crossover or self-controlled case series) and a parallel group design (cohort or case–control) were identified. Spearman correlation coefficient was used to evaluate the concordance between designs. Z-scores were used to assess whether differences in the effect estimates were common, using an absolute threshold value of 1.96. A prediction model was built to identify predictors of discrepancies.
The search identified 1,367 articles of which 53 were included for analysis. In total, 519 comparisons were made. The correlation coefficient between case-only vs. parallel group studies was 0.64 (P < .001). In 221 of the 519 comparisons (43%), the difference between both study designs was larger than the predetermined threshold. The following predictors of discrepancy were found: intermittent exposure, rare event, acute outcome, length of hazard period, type of case-only design, and sample size (C statistic of 0.783).
The concordance between effect estimates of case-only and parallel group designs is moderate. Such discrepancies could be predicted by failure to meet assumptions of case-only designs.