Drug Trials

 

There is a lot of noise now about azithromycin and hydroxychloroquine as therapy for Wuhan flu. People are demanding drug trials, people are claiming 100% cure rates, people are calling for free access to the drugs.

There’s a problem here. You can’t do a proper drug trial during an epidemic. The results of treating a critical illness will vary with an astonishing number of co-factors, many of which cannot be foreseen as you begin. For example, treating menopause with estrogens will increase strokes and heart attacks if the drug is given orally, but not when it is given transdermally. That took about 40 years to figure out.

So you have to do a proper drug trial.

A proper drug trial takes an early observation (here, HC and Azo may be effective for Wuhan flu), creates a null hypothesis (here, “treatment with HC and Azo is no better than saline”), creates a set of endpoint characteristics which are studied (days on a respirator, death rate) and controlled (sex, age, co-morbidities).

A proper drug trial then calculates the difference in the endpoint and number of cases needing to be studied to make the results statistically significant, meaning there is less than a 5% chance that said results arose by chance. Here, the difference might be that a 50% difference in death rates between the two groups, after treating 100 patients in each group, would disprove the null hypothesis.

A proper drug trial then goes through the institutional research review board to get approval for experimentation on human subjects. This, in my small experience, is often the longest part of the process.

A proper drug trial then recruits patients, either directly or at the behest of their treating Docs.

A proper drug trial then blinds the investigators as to what they are using, by providing identical-looking supplies, here perhaps bags of IV solution, half providing the drug and half providing the placebo.

A proper drug trial then consults each patient and explains that this is a randomized, controlled trial, that you must give your informed consent to participate, that there is a 50% chance you will receive placebo.

A proper drug trial then enrolls consenting patients and distributes supplies to the participating institution’s pharmacies. The pharmacies use some random method, chosen by the trial designers, to allocate therapy versus placebo.

A proper drug trial then lets events run their course until some pre-determined time when they do an interim analysis. If the study results by then conclusively disprove the null hypothesis, the study ends (that is to say, if there IS a difference between treatment with HC/Azo and saline, the study ends). If the study results do not disprove the null hypothesis, the study continues. If the results show undue harm from the study drug, say the initiation of lethal cardiac arrhythmias, the study is stopped. This is what happened to my favorite bugaboo drug trial, the Women’s Health Initiative, in 2001.

A proper drug trial thus is neither easy to design and conduct, nor quick to happen.

In an epidemic, a crisis situation, you can’t do a proper drug trial. You might follow your gut instincts and treat people with a drug if you believe it will be helpful, then see how they do. Maybe you will get good results, maybe you won’t. You’ll never know if your intervention was responsible because of the failure to randomize and control for variables.

So my hat is off to the brave ICU, general med, ER and pulmonary Docs who are treating this epidemic by the seats of their pants. They can’t wait for results from a proper drug trial. Given that fact, the politicos who know more about medicine than we do and the commentators who demand perfection have to be ignored.

Perfection is the enemy of good. We can’t do a proper drug trial here. We have to make do.

Published in Healthcare
This post was promoted to the Main Feed by a Ricochet Editor at the recommendation of Ricochet members. Like this post? Want to comment? Join Ricochet’s community of conservatives and be part of the conversation. Join Ricochet for Free.

There are 73 comments.

Become a member to join the conversation. Or sign in if you're already a member.
  1. Doctor Robert Member
    Doctor Robert
    @DoctorRobert

    Unsk (View Comment):

    Mendel: “And here’s the kicker: for all the yelling on this thread, these controlled studies have already started. One was commissioned by the NIH, the other by the WHO, both are fairly large-scale and dynamically structured to incorporate new candidates as they emerge.

    So 90% of the bickering over hydroxychloroquine and clinical trials and control groups is completely moot: trials are already being conducted at the highest level of scientific rigor conceivable under the current circumstances.”

    Okay Great! How long are these trials going to take? How long do we have to wait for their verdict while people are dying, people are getting sick and lives are being ruined? What do we do in the meantime?

    Another comment for an expert, from the Daily Caller in “Infectious Disease Expert says Anti-Malaria Drug Marks “Beginning of the End ” of the Pandemic”:

    “Infectious disease expert Stephen Smith predicted Wednesday night that an anti-malaria drug is ushering in the “beginning of the end” of the coronavirus pandemic.

    Researchers have found that hydroxychloroquine (HCQ), a drug normally used to treat malaria, is also effective in treating the virus. A recent trial conducted at Renmin Hospital at Wuhan University from Feb. 4 until Feb. 28. treated 31 patients with a five-day regimen of 400 milligrams of HCQ.”

    “President Donald Trump recently waived FDA regulations to allow the drug and others to be used to treat coronavirus patients. “

    “Smith told Fox News’ Laura Ingraham that none of the people who have been treated with the drug have had to be intubated, or put on a ventilator.”

    ““The chance of that occurring by chance according to my sons who did some stats for me are .000 something,” Smith said. “We worry about selection bias in the situation, but I cannot think of a reason why, if all else is equal, why people that have received five days or more — even four days or more of this hydroxychloroquine regimen wouldn’t get intubated.””

    “Smith called the drug a “game-changer,” and said it could put an end to this current crisis.”

    I have addressed the methodological flaws in this statement elsewhere on Ricochet.  What he says may be true, but he hasn’t proven anything.

    • #61
  2. Henry Racette Member
    Henry Racette
    @HenryRacette

    Mike Rapkoch (View Comment):
    We do not allow rhetorical gunfights on this site.

    But note the qualifier. We’re still open to the other kind. (But try to get video.)

    • #62
  3. cdor Member
    cdor
    @cdor

    Unsk (View Comment):

    “Yeah, though we could do a comparison of treatments with statistically matched groups. There are three treatments that I hear are being tossed around – HCQ / Z-pack, the HIV combination drug Kaletra, and another anti-viral from Japan. Randomize people to one of the different likely treatment groups, and compare them statistically. I think people on Ricochet have mentioned this approach before.”

    “Doc Robert actually oversimplifies. There are ways to do statistically valid tests that do NOT use a Control Group who are given a placebo. At least this is what my sister, who has worked as a statistician for numerous drug companies, tells me………….In other words, we don’t have to deny access to a potentially life-saving drug to get results that even mathematicians could accept.”

    Okay great , move forward with whatever studies that will give us greater information on various treatments as soon as possible.

    But remember people in America are dying right now because they are being denied treatment that has been proven – yes proven but perhaps not ” proven” in the eyes of our elite bureaucrats by their own regulations and protocols that they surely wrote , so can we please get as much of these life saving drugs to as many of our infected citizens as possible, with whatever caveats and legal liability disclaimers you all think advisable as soon as possible?

    I don’t really care who said what when or how here at Ricochet, but what I do care about is that those seemingly throwing mud at these treatments need to realize that our famed bureaucrats like Dr. Fauci and others have been using those comments to bolster their case to delay treatment often not because of an interest in protecting the American public but in their seemingly never ending destructive turf war these bureaucrats seem to be waging perpetually against appropriate oversight and the reduction of their Constitutionally abhorrent overly protected powers to regulate. These delays are killing people and ruining lives and these bureaucratic clowns seem not to care.

    The political background underpinning these treatment arguments is the underlying argument whether we should be ruled by “experts” as desired by the Marxist Progressives or should we be ruled by the people as directed by our Constitution.

    The “cocktail” with or without one or two of the ingredients, but all having, at least,  Hydroxychloroquine as its base ingredient is being used in hospitals all over the world. It is being used by physicians personally all over the world. We have heard of positive, even miraculous, recoveries because of using the cocktail. The ingredients are old school, having been used in other treatments for years…decades. I am asking all here who are participating in this discussion. Has anyone heard of even one anecdotal incident with a negative reaction? Here’s the thing. We are about to willfully destroy our economy. Are we such cowards, considering the risk/reward confronting our nation, that we are unwilling to utilize this option.?

    • #63
  4. Mendel Inactive
    Mendel
    @Mendel

    cdor (View Comment):
    Are we such cowards, considering the risk/reward confronting our nation, that we are unwilling to utilize this option.?

    I don’t understand where this notion of doctors being unwilling to prescribe this medication is coming from. As your own comment says, doctors are administering it around the world. That doesn’t sound like unwillingness to me.

    Or take this article from the NYT yesterday. It’s from doctors at an ICU in Brooklyn and it’s intended to depict how critical the situation is there. If ever there were an anti-Trump setting, it’s an article about New Yorkers published in the New York Times. From the article:

    Dr. Rosenberg and his team reviewed the status of one of the many patients who were receiving a “Covid cocktail” of the antimalarial drug hydroxychloroquine, held up by President Trump as a potential cure, and the antibiotic azithromycin. Dr. Rosenberg referred to it as a “maybe-maybe-this-will-work cocktail,” because only a couple of tiny studies supported its effectiveness against Covid-19. Still, the doctors were prescribing it aggressively now, early in the course of hospitalization, in the hopes that it could prevent the lung damage that led patients to need ventilators.

    Even they are prescribing it aggressively. Further down, the doctor basically says they don’t know whether it’s working, a very small number of patients had adverse side effects, but they’re going to keep on giving it to patients.

    This notion that doctors are unwilling to administer chloroquine/azithromycin is a myth.

    • #64
  5. iWe Coolidge
    iWe
    @iWe

    Mendel (View Comment):

    I don’t understand where this notion of doctors being unwilling to prescribe this medication is coming from. As your own comment says, doctors are administering it around the world. ….

    This notion that doctors are unwilling to administer chloroquine/azithromycin is a myth.

    UK government tells doctors NOT to prescribe it outside controlled trials.

    Since the NHS is government health care, these kinds of injunctions may actually be dictating what doctors are doing.

    • #65
  6. Mendel Inactive
    Mendel
    @Mendel

    iWe (View Comment):

    Mendel (View Comment):

    I don’t understand where this notion of doctors being unwilling to prescribe this medication is coming from. As your own comment says, doctors are administering it around the world. ….

    This notion that doctors are unwilling to administer chloroquine/azithromycin is a myth.

    UK government tells doctors NOT to prescribe it outside controlled trials.

    Since the NHS is government health care, these kinds of injunctions may actually be dictating what doctors are doing.

    Fair enough. There is quite a bit about the British response I’ve been shaking my head at, looks like there’s one more thing to add to the list.

    At least in the US, and many countries in Europe (including Italy and Germany), doctors are free to administer the combo as they feel appropriate.

    • #66
  7. Ontheleftcoast Inactive
    Ontheleftcoast
    @Ontheleftcoast

    Henry Racette (View Comment):

    Mike Rapkoch (View Comment):
    We do not allow rhetorical gunfights on this site.

    But note the qualifier. We’re still open to the other kind. (But try to get video.)

     

     

    • #67
  8. Ontheleftcoast Inactive
    Ontheleftcoast
    @Ontheleftcoast

    Henry Racette (View Comment):

    Mike Rapkoch (View Comment):
    We do not allow rhetorical gunfights on this site.

    But note the qualifier. We’re still open to the other kind. (But try to get video.)

    Also, be sure to stay more than six feet apart. Gotta stay safe in whatever you do.

    • #68
  9. Judge Mental, Secret Chimp Member
    Judge Mental, Secret Chimp
    @JudgeMental

    Mendel (View Comment):

    iWe (View Comment):

    Mendel (View Comment):

    I don’t understand where this notion of doctors being unwilling to prescribe this medication is coming from. As your own comment says, doctors are administering it around the world. ….

    This notion that doctors are unwilling to administer chloroquine/azithromycin is a myth.

    UK government tells doctors NOT to prescribe it outside controlled trials.

    Since the NHS is government health care, these kinds of injunctions may actually be dictating what doctors are doing.

    Fair enough. There is quite a bit about the British response I’ve been shaking my head at, looks like there’s one more thing to add to the list.

    At least in the US, and many countries in Europe (including Italy and Germany), doctors are free to administer the combo as they feel appropriate.

    Did you hear the order from the governor of Michigan?  Administrative action (loss of license?) will be taken against any doctors who prescribe or pharmacists who dispense these drugs for Covid.  That was about ten days ago, and I don’t know if it was rescinded, but since then you’ve heard Michigan discussed as the next hot spot.

    And of course, Fauci said he would only prescribe it for a sick family member if they could be part of a clinical trial.  Hopefully, that’s a lie, because if it’s true he’s a monster.

    • #69
  10. cdor Member
    cdor
    @cdor

    Judge Mental, Secret Chimp (View Comment):

    Mendel (View Comment):

    iWe (View Comment):

    Mendel (View Comment):

    I don’t understand where this notion of doctors being unwilling to prescribe this medication is coming from. As your own comment says, doctors are administering it around the world. ….

    This notion that doctors are unwilling to administer chloroquine/azithromycin is a myth.

    UK government tells doctors NOT to prescribe it outside controlled trials.

    Since the NHS is government health care, these kinds of injunctions may actually be dictating what doctors are doing.

    Fair enough. There is quite a bit about the British response I’ve been shaking my head at, looks like there’s one more thing to add to the list.

    At least in the US, and many countries in Europe (including Italy and Germany), doctors are free to administer the combo as they feel appropriate.

    Did you hear the order from the governor of Michigan? Administrative action (loss of license?) will be taken against any doctors who prescribe or pharmacists who dispense these drugs for Covid. That was about ten days ago, and I don’t know if it was rescinded, but since then you’ve heard Michigan discussed as the next hot spot.

    And of course, Fauci said he would only prescribe it for a sick family member if they could be part of a clinical trial. Hopefully, that’s a lie, because if it’s true he’s a monster.

    My point  from #63 is that Fauci of the NIH and Hahn of the FDA are bureaucrat scientists who, understandably, because of their professions, need evidence that will take months to develop. That’s fine. Let them do their thing. But in the meantime, our country is burning. We need the firemen, not the bureaucrats. Things are moving very fast. It is possible that Trump is already buying up as much Hydroxy as he can and ordering more. But it appears to be very effective as a prophylactic against this scourge. If people took it in mass, wouldn’t that enable the country to get back to work while giving the studies time to find an ultimate cure? Old people and the unhealthy could still stay semi-quarantined while the 60 and younger take the Hydroxy and go back to work.

    • #70
  11. Percival Thatcher
    Percival
    @Percival

    Judge Mental, Secret Chimp (View Comment):
    Did you hear the order from the governor of Michigan? Administrative action (loss of license?) will be taken against any doctors who prescribe or pharmacists who dispense these drugs for Covid. That was about ten days ago, and I don’t know if it was rescinded, but since then you’ve heard Michigan discussed as the next hot spot.

    Followed four days later by a request to the Feds to ship the stuff to Michigan. Gretchen’s government is spinning like a top.

    • #71
  12. Ontheleftcoast Inactive
    Ontheleftcoast
    @Ontheleftcoast

    Judge Mental, Secret Chimp (View Comment):
    And of course, Fauci said he would only prescribe it for a sick family member if they could be part of a clinical trial. Hopefully, that’s a lie, because if it’s true he’s a monster.

    Fauci also said

    Yeah, of course, particularly if people have no other option,” Fauci said, according to Townhall. “These drugs are approved drugs for other reasons. They’re anti-malaria drugs, and they’re drugs against certain autoimmune diseases like lupus. Physicians throughout the country can prescribe that in an off-label way. Which means they can write it for something it was not approved for.”

    Perhaps this circle can be squared by saying that Fauci himself wouldn’t write a prescription for off-label use for a relative because he runs NIAID. I’m not sure he’s actively seeing patients, either. [Addendum: I know and respect non-practicing physicians who for that reason alone wouldn’t write a scrip for a relative unless there was absolutely no other physician to do so; I doubt that that would be the case for any relative of the director of NIAID.]

    I don’t like the man and I think his priorities are skewed, but I think that calling him a monster over this isn’t fair.

    • #72
  13. MISTER BITCOIN Inactive
    MISTER BITCOIN
    @MISTERBITCOIN

    Doctor,

    In your experience which pharmaceutical companies conduct good clincial trials?

    I know Merck had a setback in 2002 or 2003 because of Vioxx.

    What if pharma companies post results of their clinical trials and let the doctors and their patients decide on safety and efficacy?

    You allude to a p-value <= 5% but what if p-value is 6%?

    6% won’t get you published but is there a clinical difference between 5 and 6 percent?

    If you wanted to employ 6 sigma, p-value would be <= 0.3%, in other words 99.7% confidence interval.

    Sir Ronald Fisher said if you can replicate the same result 19 out of 20 times, it is unlikely due to random luck.

    19/20 = 95%

     

    • #73
Become a member to join the conversation. Or sign in if you're already a member.