top of page
Contact Us

Multiple Endpoints in Clinical Trials: Why Medical Device Manufacturers Can't Afford to Ignore Multiplicity


The Hidden Danger: Type I Error Inflation


When you test multiple endpoints without proper statistical adjustment, your chance of making a false positive conclusion skyrockets.


Example from FDA's 2022 Multiple Endpoints guidance:
  • Single endpoint trial: 2.5% chance of false positive (Type I error)
  • Two independent endpoints: 5% chance of false positive
  • Ten independent endpoints: 22% chance of false positive

That's nearly a 1-in-4 chance of falsely concluding your device is effective when it's not. For medical device manufacturers, this isn't just a statistical concern — it's a regulatory disaster waiting to happen.


Why the FDA Takes Multiplicity Seriously


The FDA's concern about multiple endpoints isn't academic. It's about protecting patients and ensuring that approved devices truly deliver the benefits claimed in their labeling. When multiplicity isn't properly controlled, the agency cannot have confidence in study results.

This applies equally to medical devices. The FDA expects sponsors to demonstrate substantial evidence of effectiveness, and multiple endpoints without proper multiplicity control can undermine that demonstration.


Real-World Consequences for Medical Device Companies


A medical device company conducted a pivotal trial with three primary endpoints: pain reduction, functional improvement, and radiographic success. Each endpoint was tested independently at α = 0.05. Without multiplicity adjustment, the overall Type I error rate was approximately 14% — far above the acceptable 2.5% threshold. The FDA required additional data, delaying approval by years and costing the company millions in additional development costs.


BSC®'s Approach: Decades of FDA Success


1. Prospective Planning — We work with sponsors to prospectively specify all endpoints, analysis methods, and multiplicity adjustments before trial initiation. The FDA expects these decisions to be made before data analysis begins.

2. Endpoint Hierarchy Development — We help establish clear hierarchies of primary, secondary, and exploratory endpoints based on clinical importance and regulatory requirements.

3. Statistical Method Selection — Our team selects the most appropriate multiplicity adjustment method based on number and correlation of endpoints, clinical importance hierarchy, study power requirements, and FDA expectations for the specific device type.

4. FDA Interaction Strategy — We have helped sponsors navigate the regulatory dialogue around multiple endpoint strategies, ensuring alignment with agency expectations.


The BSC® Advantage


What sets BSC® apart is our deep understanding of both statistical theory and FDA regulatory reality: hundreds of successful FDA submissions, specialized expertise in medical devices (particularly orthopedic, neurological, spine, and diagnostics), direct FDA panel meeting experience with multiple endpoint strategies, and cutting-edge statistical methods including Bayesian approaches, adaptive designs, and propensity score matching.


Key Takeaways


  1. Handling multiplicity is not optional — Every trial with multiple endpoints requires a prospectively specified multiplicity control strategy.
  2. FDA scrutiny is increasing — The 2022 guidance reflects FDA's heightened attention to multiple endpoint issues.
  3. Early planning is critical — Multiplicity strategies must be developed before trial initiation, not after data analysis.
  4. Expert guidance pays dividends — Proper multiplicity control can mean the difference between FDA approval and costly delays.

Ready to discuss your multiple endpoint strategy? Contact BSC® for a consultation. Our 35+ years of experience can help you avoid the multiplicity trap and accelerate your path to regulatory approval.

Beyond The Page

Expertise in Every Niche.

Congratulations to Brendan Keenan and Greg Maislin for their recent publication on Propensity Score designs!

In the article, the authors propose that Propensity Score designs are the optimal approach to address the impact of continuous positive airway pressure (CPAP) on cardiovascular events.

Congratulations to BSC®’s David Maislin, Alex Breno, and our friends at 3Spine on their recent publication!

The article lays out the protocol for the pivotal IDE trial behind 3Spine's MOTUS® lumbar Total Joint Replacement, the first device built to restore both disc and facet joint function without sacrificing motion. 

Congratulations to David Maislin and Brendan Keenan on their article in collaboration with UPenn!

This article cover the effect of Obstructive Sleep Apnea and Positive Airway Pressure Therapy on Cardiac Remodeling in Non-Obese and Obese Adults.

WHAT CLIENTS SAY

“They listen the first time. I’ve never had to go back and respell out what I needed." 


”They work to understand the problem and leverage the information that is already there.”

Former FDA Regulator

WHAT CLIENTS SAY

"Battle ground tested."


"There is nothing that David and team haven’t seen over the years – the good, bad, and ugly.”

Vice President, Clinical Operations

WHAT CLIENTS SAY

"Get stuff done when you have to do something no one else has done before."


"They aren’t afraid to tackle difficult scenarios in compressed timelines."

CEO, Medical Device Company

BSC® Differentiator

What Sets us Apart

Submission Grade Experience

Regulatory-first biostatistics

Support built specifically for FDA-facing programs, from early feasibility through submission and post-market requirements.

Direct communication, faster turn around

Our biostatisticians write the SAP and run the analysis. One person owns both — no separate programmer, no project manager in between.

Versatile Solutions

Engage us for a focused analysis or a full submission, We size the work to the problem.

Proven FDA Experience

Hands-On Experience with FDA Pathways, statistical reviews, and regular interactions, reducing risk and rework.

bottom of page