VIDEO
HIGHLIGHT
Log InSign up
Ben Goldacre: Battling Bad Science
SummaryTranscriptChat

Ben Goldacre: Battling Bad Science

What is Epidemiology?

Introduction to Epidemiology

  • The speaker, a doctor turned epidemiologist, explains that epidemiology is the science of determining what is beneficial or harmful to health in real-world contexts.
  • The concept is illustrated through sensational newspaper headlines that categorize various inanimate objects as either cancer-causing or cancer-preventing.

Contradictory Claims in Health Reporting

  • Examples from the Daily Mail highlight contradictions, such as coffee being both a cause and a preventive measure for cancer.
  • The speaker emphasizes the need to critically analyze these claims, suggesting that understanding evidence behind dubious assertions can be socially beneficial.

The Importance of Evidence-Based Medicine

Critique of Authority in Science

  • The weakest form of evidence is authority; scientific credibility should not rely on titles but rather on substantiated reasoning.
  • An example given is Dr. Gillian McKeith, who promotes unverified health advice despite lacking credible qualifications.

Misleading Scientific Headlines

  • A headline claiming red wine prevents breast cancer leads to an examination of actual research which shows no direct correlation between red wine consumption and reduced risk.
  • Another misleading claim about olive oil's effect on wrinkles illustrates how observational studies can misrepresent causation versus correlation.

Understanding Trials and Their Significance

Observational Studies vs. Controlled Trials

  • Observational studies often fail to account for confounding variables; people who consume healthy diets may have other advantages leading to fewer wrinkles.
  • The ideal approach involves controlled trials where participants are randomly assigned different treatments to assess outcomes accurately.

Historical Context of Trials

Fish Oil Pills and Their Impact on School Performance

Overview of the Trial

  • The claim is that fish oil pills improve school performance and behavior in mainstream children. Concerns arise when researchers express certainty about trial outcomes before conducting them, indicating potential bias or pre-existing data.
  • The trial involved 3,000 children receiving six large fish oil pills daily, with their exam performance measured a year later against predicted outcomes without the pills.

Flaws in Trial Design

  • A significant flaw identified is the absence of a control group, which raises questions about attributing any observed improvements solely to the pills. Other factors like maturation and placebo effects could influence results.
  • The placebo effect plays a crucial role; it encompasses not just physical changes from taking a pill but also psychological aspects such as beliefs and expectations regarding treatment efficacy.

Placebo Effect Insights

  • Research shows that two sugar pills are more effective than one for treating gastric ulcers, highlighting how dosage can impact perceived effectiveness due to psychological factors.
  • An injection may feel more impactful than a sugar pill, demonstrating how our perceptions can be manipulated to enhance treatment outcomes.

Distortion of Evidence in Trials

  • Journalists and supplement marketers often distort evidence for personal gain. Similarly, the pharmaceutical industry employs sophisticated methods to manipulate data presented to doctors and patients.
  • Many trials compare new drugs against placebos rather than existing effective treatments, leading to misleading conclusions about drug efficacy.

Data Manipulation Techniques

  • Drug companies can skew results by using ineffective doses of competing medications or by presenting only favorable data while withholding negative findings from trials.
  • Historical examples include antipsychotic medication trials where older drugs were administered at excessively high doses to make newer drugs appear superior.

Industry Practices and Missing Data

  • When new-generation antipsychotics came off patent, trials compared them against older drugs at high doses again, ensuring positive results for new medications while neglecting proper dosing standards.
  • Industry-funded trials tend to yield positive results four times more often than independent studies due to selective reporting practices that favor certain outcomes over others.

Importance of Comprehensive Data

  • Understanding treatment effectiveness requires access to all relevant data; missing negative data skews perceptions of drug efficacy significantly.

Understanding Publication Bias in Medical Trials

The Impact of Publication Bias

  • Large trials tend to cluster closer to the true effect size, while smaller trials often show spurious false negatives and positives. This discrepancy highlights the issue of publication bias where negative results may not be published.
  • A graph illustrates the absence of small negative trials, emphasizing how publication bias skews the perception of research outcomes. The speaker humorously notes this as a "funniest epidemiology joke."

Case Study: Reboxetine

  • The speaker discusses reboxetine, a drug he has prescribed, which had all positive trial results reported. However, it was later revealed that 76% of its trials were withheld from public knowledge.
  • By withholding data, one can manipulate perceptions; for example, if half the coin toss results are hidden, one could falsely claim a two-headed coin. This analogy underscores the importance of complete data transparency.

Broader Implications in Antidepressant Research

  • Approximately half of all trial data on antidepressants is withheld from healthcare professionals and patients. This lack of transparency complicates understanding the true effectiveness of these medications.
  • The Nordic Cochrane Group's efforts to access comprehensive trial data have been obstructed by pharmaceutical companies and regulatory bodies like the European Medicines Agency for years.

Ethical Concerns with Tamiflu

  • Governments worldwide have invested billions in Tamiflu based on claims it reduces flu complications. However, existing data only shows minimal benefits regarding symptom duration.
  • The Infectious Diseases Cochrane Group has struggled to obtain full data from drug companies to assess Tamiflu's efficacy accurately. This situation represents a significant ethical dilemma in modern medicine.

Conclusion: Need for Transparency

Channel: TED
Video description

http://www.ted.com Every day there are news reports of new health advice, but how can you know if they're right? Doctor and epidemiologist Ben Goldacre shows us, at high speed, the ways evidence can be distorted, from the blindingly obvious nutrition claims to the very subtle tricks of the pharmaceutical industry. TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes. Featured speakers have included Al Gore on climate change, Philippe Starck on design, Jill Bolte Taylor on observing her own stroke, Nicholas Negroponte on One Laptop per Child, Jane Goodall on chimpanzees, Bill Gates on malaria and mosquitoes, Pattie Maes on the "Sixth Sense" wearable tech, and "Lost" producer JJ Abrams on the allure of mystery. TED stands for Technology, Entertainment, Design, and TEDTalks cover these topics as well as science, business, development and the arts. Closed captions and translated subtitles in a variety of languages are now available on TED.com, at http://www.ted.com/translate.