Abstract
Over the past decade, an increasing number of observational studies have examined the effectiveness or safety of treatments for rheumatoid arthritis. Unlike randomized controlled trials (RCTs), however, observational studies of drug effects have methodological limitations such as confounding by indication. Active-comparator designs and new-user designs can help mitigate such biases in observational studies and improve the validity of their findings by making them more closely approximate RCTs. In an active-comparator study, the drug of interest is compared with another agent commonly used for the same indication, rather than with no treatment (a 'non-user' group). This principle helps to ensure that treatment groups have similar treatment indications, attenuating both measured and unmeasured differences in patient characteristics. The new-user study includes a cohort of patients from the time of treatment initiation, enabling assessment of patients' pretreatment characteristics and capture of all events occurring during follow-up. These two principles should be considered when designing or reviewing observational studies of drug effects.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Rent or buy this article
Prices vary by article type
from$1.95
to$39.95
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Chan, K. A. & Hernandez-Diaz, S. Pharmacoepidemiology and rheumatic disorders. Rheum. Dis. Clin. North Am. 30, 835–850 (2004).
Schneeweiss, S., Gagne, J. J., Glynn, R. J., Ruhl, M. & Rassen, J. A. Assessing the comparative effectiveness of newly marketed medications: methodological challenges and implications for drug development. Clin. Pharmacol. Ther. 90, 777–790 (2011).
Strom, B. L., Kimmel, S. E. & Hennessy, S. (Eds) Textbook of Pharmacoepidemiology (Wiley-Blackwell, 2013).
Walker, A. M. & Stampfer, M. J. Observational studies of drug safety. Lancet 348, 489 (1996).
Psaty, B. M. & Siscovick, D. S. Minimizing bias due to confounding by indication in comparative effectiveness research: the importance of restriction. JAMA 304, 897–898 (2010).
Rosenbaum, P. R. & Rubin, D. B. The central role of the propensity score in observational studies for causal effects. Biometrika 70, 41–55 (1983).
Crump, R. K., Hotz, V. J., Imbens, G. W. & Mitnik, O. A. Dealing with limited overlap in estimation of average treatment effects. Biometrika 96, 187–199 (2009).
Petersen, M. L., Porter, K. E., Gruber, S., Wang, Y. & van der Laan, M. J. Diagnosing and responding to violations in the positivity assumption. Stat. Methods Med. Res. 21, 31–54 (2012).
Dixon, W. G. et al. Drug-specific risk of tuberculosis in patients with rheumatoid arthritis treated with anti-TNF therapy: results from the British Society for Rheumatology Biologics Register (BSRBR). Ann. Rheum. Dis. 69, 522–528 (2010).
Sternberg, S. A., Wershof Schwartz, A., Karunananthan, S., Bergman, H. & Clarfield, A. M. The identification of frailty: a systematic literature review. J. Am. Geriatr. Soc. 59, 2129–2138 (2011).
Glynn, R. J., Knight, E. L., Levin, R. & Avorn, J. Paradoxical relations of drug treatment with mortality in older persons. Epidemiology 12, 682–689 (2001).
Eurich, D. T., Marrie, T. J., Johnstone, J. & Majumdar, S. R. Mortality reduction with influenza vaccine in patients with pneumonia outside 'flu' season: pleiotropic benefits or residual confounding? Am. J. Respir. Crit. Care Med. 178, 527–533 (2008).
Camelo Castillo, W., Delaney, J. A. C. & Stürmer, T. The challenges of comparing results between placebo controlled randomized trials and non-experimental new user, active comparator cohort studies: the example of olmesartan. Pharmacoepidemiol. Drug Saf. 23, 357–360 (2014).
Ray, W. A. Evaluating medication effects outside of clinical trials: new-user designs. Am. J. Epidemiol. 158, 915–920 (2003).
Johnson, E. S. et al. The incident user design in comparative effectiveness research. Pharmacoepidemiol. Drug Saf. 22, 1–6 (2013).
Strangfeld, A. et al. Treatment benefit or survival of the fittest: what drives the time-dependent decrease in serious infection rates under TNF inhibition and what does this imply for the individual patient? Ann. Rheum. Dis. 70, 1914–1920 (2011).
Choi, H. K., Nguyen, U.-S., Niu, J., Danaei, G. & Zhang, Y. Selection bias in rheumatic disease research. Nat. Rev. Rheumatol. 10, 403–412 (2014).
Curtis, J. R. et al. Risk of serious bacterial infections among rheumatoid arthritis patients exposed to tumor necrosis factor α antagonists. Arthritis Rheum. 56, 1125–1133 (2007).
Dixon, W. G. et al. Serious infection following anti-tumor necrosis factor α therapy in patients with rheumatoid arthritis: lessons from interpreting data from observational studies. Arthritis Rheum. 56, 2896–2904 (2007).
Askling, J. et al. Cancer risk in patients with rheumatoid arthritis treated with anti-tumor necrosis factor α therapies: does the risk change with the time since start of treatment? Arthritis Rheum. 60, 3180–3189 (2009).
Schisterman, E. F., Cole, S. R. & Platt, R. W. Overadjustment bias and unnecessary adjustment in epidemiologic studies. Epidemiology 20, 488–495 (2009).
Suissa, S. Immortal time bias in observational studies of drug effects. Pharmacoepidemiol. Drug Saf. 16, 241–249 (2007).
Levesque, L. E., Hanley, J. A., Kezouh, A. & Suissa, S. Problem of immortal time bias in cohort studies: example using statins for preventing progression of diabetes. BMJ 340, b5087 (2010).
Rothman, K. J., Greenland, S. & Lash, T. L. Modern Epidemiology (Lippincott Williams & Wilkins, 2012).
Grijalva, C. G. et al. Initiation of tumor necrosis factor-α antagonists and the risk of hospitalization for infection in patients with autoimmune diseases. JAMA 306, 2331–2339 (2011).
Strangfeld, A. et al. Risk of incident or recurrent malignancies among patients with rheumatoid arthritis exposed to biologic therapy in the German biologics register RABBIT. Arthritis Res. Ther. 12, R5 (2010).
Acknowledgements
S.C.K.'s work is supported by a grant from the NIH (K23AR059677).
Author information
Authors and Affiliations
Contributions
K.Y. researched data for the article. All authors provided substantial contributions to discussion of the content, writing and reviewing or editing of the manuscript before submission.
Corresponding author
Ethics declarations
Competing interests
K.Y. has received tuition support jointly from Japan Student Services Organization (JASSO) and Harvard T. H. Chan School of Public Health (supported in part by training grants from Bayer, PhRMA, Pfizer and Takeda). D.H.S. has received research/funding support from Amgen, Lilly and CORRONA, received royalties from UpToDate and served in unpaid roles in studies funded by Lilly, Novartis and Pfizer. S.C.K. has received research support from Lilly and Pfizer.
Supplementary information
Supplementary Table 1
Cohort studies of infections associated with biologic DMARD use in patients with rheumatoid arthritis. (DOCX 1071 kb)
Supplementary Table 2
Cohort studies of cancers associated with biologic DMARD use in patients with rheumatoid arthritis. (DOCX 949 kb)
Rights and permissions
About this article
Cite this article
Yoshida, K., Solomon, D. & Kim, S. Active-comparator design and new-user design in observational studies. Nat Rev Rheumatol 11, 437–441 (2015). https://doi.org/10.1038/nrrheum.2015.30
Published:
Issue Date:
DOI: https://doi.org/10.1038/nrrheum.2015.30
This article is cited by
-
Risk and effect modifiers for poor glycemic control among the chinese diabetic adults on statin therapy: the kailuan study
Clinical Research in Cardiology (2024)
-
High-throughput target trial emulation for Alzheimer’s disease drug repurposing with real-world data
Nature Communications (2023)
-
Impact of "time zero" of Follow-Up Settings in a Comparative Effectiveness Study Using Real-World Data with a Non-user Comparator: Comparison of Six Different Settings
Drugs - Real World Outcomes (2023)
-
Glucose-Lowering Agents and the Risk of Hypoglycemia: a Real-world Study
Journal of General Internal Medicine (2023)
-
Effectiveness and safety of direct oral anticoagulants versus warfarin in patients with atrial fibrillation and advanced kidney disease
Journal of Thrombosis and Thrombolysis (2023)