AAD
  • Meeting Program
  • Registration
  • Daily Coverage
  • Photo Gallery
  • Samples & Solutions
Topics
  • Daily Coverage
  • Photo Gallery
  • Samples & Solutions
Resources
  • Meeting Program
  • Registration
Facebook iconInstagram iconTwitter X icon
Mar 19, 2023

A healthy dose of skepticism

The right tools can help you weigh inherent uncertainty in medical research.


Wheless Malachowski

The world is filled with uncertainty — even when it comes to the most carefully researched medical study. Learning to recognize that uncertainty is key to having a better understanding of those studies and how they can benefit your patients.

During  “U025 – Uncertainties Masquerading as Certainties: Can You Trust the Study You Just Read?” Stephen Malachowski, MD, MS, dermatology resident at Virginia Commonwealth University’s Department of Dermatology in Richmond, said using statistical tools and keeping certain ethical and logical considerations in mind can aid in the correct interpretation of medical literature.

“When the goal is to positively impact patient care, clinicians and researchers alike should strive to step outside of their comfort zone to reason with data, and question statistical assumptions,” he said.

Assessing the variables

One common mistake people make when developing studies is dichotomizing — or categorizing — quantitative variables. 

“An example would be to take age as it is measured but deciding to classify people as below some age limit or not,” Dr. Malachowski said. “This is problematic in many ways. First, information is lost, which mathematically reduces the statistical power of a study. In the case of a randomized clinical trial, the study must now recruit more patients to the trial to reach the same amount of information. If we create information loss that requires us to recruit more people than necessary, this raises the ethical consideration of exposing more people than needed to the risks of the trial.”

Dr. Malachowski said dermatologists should review study statistics such as sensitivity (how often a positive test is rendered to patients who have the disease in question) and specificity (how often a negative test is rendered to a healthy patient) with caution.

“The problem with this is inherent in the interpretation,” he said. “For a diagnosis, we don’t yet know if a patient has a disease, so something like sensitivity or specificity alone cannot tell us much about diagnosis. In fact, sensitivity and specificity are ‘backward’ for diagnosis because we don’t know who has the disease at the time of completing a test. We only know the test result and try to use the result, along with other information, to make a diagnosis.”

Limitations at play

Lee Wheless, MD, PhD, FAAD, assistant professor of dermatology and epidemiology at Vanderbilt University Medical Center in Nashville, Tennessee, said when it comes to reviewing a study, it is important to understand the limitations of its p-value (the likelihood that the study will find a particular set of observations to be associated with the outcome if there is no difference among the groups being studied) and its confidence interval (the range of values that are plausible, based on the data).

“It’s important to keep in mind that both of these values are really measures of how well a model explains the data in the study,” Dr. Wheless said. “A p-value does not reflect the clinical importance of the finding but rather can speak to how likely or not it is the variables in the model describe the relationship with the outcome. Similarly, a confidence interval does not tell us that ‘truth’ is found 95% of the time within its bounds. Rather, confidence intervals give us a sense of how certain we are about the estimates made by the model. Neither a p-value or a confidence interval tells us about the probability or truth of an error, which is a common misconception.”

The ripple effect

Drs. Wheless and Malachowski said it is important to recognize uncertainty in medical research because a clinical mistake based on a dermatologist’s uncertainty will affect a single patient, but an uncertain measure in a study that becomes accepted as truth has the potential to impact many patients.

Dr. Malachowski echoed that sentiment with an old adage. “There is an old saying: ‘The trouble with people is not that they don’t know but that they know so much that ain’t so,’” he said. “Recognizing uncertainty in medical research is important because the world we live in is filled with uncertainty, even about things we think we understand. Without recognizing uncertainty, patients may receive treatments that appear to work but don’t, or we may dismiss treatments that might work but are written off without proper evidence.”   

Visit AAD DermWorld Meeting News Central for more articles.

Interesting Stories
DermWorld February | Glow Up
Presented by AAD
DermWorld February | Glow Up
DermWorld March | Publishing profiteers
Presented by AAD
DermWorld March | Publishing profiteers
DermWorld November | Scent-itive skin
Presented by AAD
DermWorld November | Scent-itive skin
DermWorld December | Disease reporting
Presented by AAD
DermWorld December | Disease reporting
DermWorld  January | Scar solutions
Presented by AAD
DermWorld January | Scar solutions
DermWorld April | Shedding light on treatments for female pattern hair loss
Presented by AAD
DermWorld April | Shedding light on treatments for female pattern hair loss
More in AAD 2023 Annual Meeting
2022 03 21 12 26 25 6238b55bf2d38
AAD 2023 Annual Meeting
Claim CME
Claim CME
Feb 19, 2024
Phone in hand showing mobile app
2024 AAD Annual Meeting
Download the Annual Meeting app
Download the AAD Meeting app here
Feb 17, 2024
Session Director Raj Chovatiya, MD, PhD, FAAD
AAD 2023 Annual Meeting
When it looks and itches like atopic dermatitis. But isn’t.
Apr 07, 2023
Left to right: Kelly Tyler, MD, FAAD, and Howa Yeung, MD, FAAD
AAD 2023 Annual Meeting
Lifting the veil
Apr 07, 2023
Session director Trilokraj Tejasvi, MD, MBBS
AAD 2023 Annual Meeting
Decoding the benefits and burdens of technology in dermatology
Apr 07, 2023
Left to right: Rebecca I. Hartman, MD, MPH, FAAD, Abigail Baird Waldman, MD, FAAD, and Emily S. Ruiz, MD, FAAD.
AAD 2023 Annual Meeting
Surgery is not the only option for skin cancers
Apr 07, 2023
Terrence A. Cronin Jr., MD, FAAD
AAD 2023 Annual Meeting
From 17 to 20,000: New president accepts challenge of Academy’s 85-year growth
Apr 07, 2023
Left to right: Maria Aleshin, MD, FAAD, and Silvina Pugliese, MD, FAAD
AAD 2023 Annual Meeting
Beyond the familiar
Apr 07, 2023
Safi Bahcall
AAD 2023 Annual Meeting
Nurture the unexpected
Mar 20, 2023
Richard L. Gallo, MD, PhD, FAAD
AAD 2023 Annual Meeting
New approach uses microbiome to treat skin disease
Mar 20, 2023
Camp Discovery 92
AAD 2023 Annual Meeting
Refer a patient to Camp Discovery!
Mar 20, 2023
Amy J. McMichael, MD, FAAD
AAD 2023 Annual Meeting
A question of belonging
Mar 20, 2023
AAD
Facebook iconInstagram iconTwitter X icon
© Ascend Media All rights reserved. DermWorld Meeting News Central is a publication of the American Academy of Dermatology.