Trial Designs—Non-inferiority vs. Superiority vs. Equivalence

Trial Designs—Non-inferiority vs. Superiority vs. Equivalence

The primary purpose of a clinical trial is to address a scientific hypothesis. To address a hypothesis, different statistical methods are used depending on the type of question to be answered. Most often the hypothesis is related to the effect of one treatment as compared to another. For example, one trial could compare the effectiveness of a new antibiotic to that of an older antibiotic. Yet the specific comparison to be used will depend on the hypothesis to be addressed. Let’s use this two antibiotic example for this discussion.

We can construct 3 possible hypothesis to be addressed when comparing these two antibiotics. The three hypothesis are:

  1. The New Antibiotic is at least as good as the Old Antibiotic.
  2. The New Antibiotic is better than the Old Antibiotic.
  3. The New Antibioitic is equivalent to the Old Antibiotic.

While each of these hypothesis may seem similar, they are slightly different scientific questions, thus each requires a slightly different statistical test. For the first hypothesis (“at least as good as”), the New Antibiotic must be as good as the Old Antibiotic, but it can also be better than the Old Antibioitic. In mathematical terms:

1.  New Antibiotic \ge Old Antibiotic

For the second hypothesis (“better than”), the New Antibiotic can no longer be equivalent to the Old Antibiotic. In mathematical terms:

2.  New Antibiotic \textgreater Old Antibiotic

The last hypothesis (“equivalent to”) indicates that the New Antibiotic cannot be worse than or better than the Old Antibiotic. In mathematical terms:

3.  \frac{New Antibiotic}{Old Antibiotic} = 1\pm \alpha

As you can see, each hypothesis contains a slightly different mathematical arrangement. These mathematical expressions have been given “lay names” by satisticians in an effort to describe the math to non-statisticians; these names are:

  1. Non-inferiority
    •  New Antibiotic \ge Old Antibiotic
  2. Superiority
    •  New Antibiotic \textgreater Old Antibiotic
  3. Bioequivalence
    •  \frac{New Antibiotic}{Old Antibiotic} = 1\pm \alpha

Of these three comparisons, the non-inferiority has the largest range of successful trial outcomes (equivalence or superiority). Thus a calculated sample size for a non-inferiority trial is usually the smallest of the three hypothesis. The superiority comparison is a subset of the non-inferiority and will have a sample size that is similar to the non-inferiority or a sample size that is much larger. As the expected difference between the two treatments decreases, the sample size will increase, often dramatically. Finally, the bioequivalence comparison is the most restrictive because it requires that the two treatments be identical within some acceptable range defined by α (normally ±20%). In general a bioequivalence trial will have a sample size that is larger than a non-inferiority trial.

So which is best to use? It all depends on which scientific question you are trying to answer. All three study types are useful in the development of drugs. Non-inferiority studies are used to show that a minimum level of efficacy has been achieved. In comparison studies with a current therapy, non-inferiority is used to demonstrate that the new therapy provides at least the same benefit to the patient. Superiority trials are always used when comparisons are made to placebo or vehicle treatments. In these studies, it is critical that the effect in the treatment group be clearly superior to any effects in the placebo groups. Failure to demonstrate superiority over vehicle suggests that the drug is not effective. Superiority trials are also used for marketing purposes (“our drug is better than your drug” studies). Bioequivalence trials are used to show that a new treatment is identical (within an acceptable range) to a current treatment. This is used in the registration and approval of generic drugs that are shown to be bioequivalent to their branded reference drugs.

In the end, ask yourself which hypothesis am I trying to address, then use the appropriate study design. Best of luck!

Making the right choices in drug development often means the difference between getting a new medication to patients and it ending up in the scrap heap of failed programs. Model-based meta-analysis (MBMA) integrates internal and external drug development data to inform proprietary commercial and R&D decisions. Read this white paper to learn how MBMA can be used to predict the likelihood of a new drug showing superiority or non-inferiority to the competition.

Nathan Teuscher

About the Author

Nathan Teuscher

More Posts by This Author

Dr. Nathan Teuscher is the Vice President of Pharmacometric Solutions at Certara. He is an expert in clinical pharmacology, pharmacometrics, pharmacokinetics and pharmacodynamics and was trained by David Smith at the University of Michigan. Dr. Teuscher has held leadership positions in biotechnology, pharmaceutical and contract research companies. In 2008 he established the Learn website to share his knowledge with the community. Prior to coming to Certara, he was the Founder and President of PK/PD Associates.