Ask the Experts- MCC Answers Your Metric Questions

With more organizations focusing on metrics, the MCC has received an increase of questions ranging from how to use metrics, why some metrics are better than others, which type of metrics is best to use, as well as questions about specific MCC Metrics. This column provides a forum for us to share these questions and answers with you.

MCC Members at the Gold or Platinum benefit level, can access the “MCC Ask the Experts – Questions and Answers Archive” by logging into the MCC member website. Interested in becoming a member or have questions about your membership? Contact membership director, Terry Holland.

June 2019

A: MCC is expanding the metrics defined at a portfolio level (across studies) as the metric sets are being updated. We are planning to update the CTPM v1.3 set of metrics later this year. In the meantime, I recommend you be careful about averaging results across studies. In doing so, you are not taking account of the study size: e.g. the average could include one study with 100 patients planned that is at 150% and another with 2,000 patients planned that is at 80%. The average is 115% but what does that really tell you? You need to understand the question you are seeking to answer when you develop portfolio level metrics.

The MCC Vendor Oversight Work Group explored different ways to aggregate study level data when they developed portfolio-level milestone metrics. They defined metrics that compared results by looking at the percentage of milestones that were met:

    •  For all studies from their start date
    •  During a specific period of time slice – such as a three-month period
    •  For each study
    •  For each study phase (start-up, conduct, closeout)

A similar approach could be used with the percentage of subjects enrolled – so long term and recent performance can be reviewed. Instead of study phase, you could group results by therapeutic area.

Meet the Experts

Keith Dorricott, MCC Ambassador and Director,
Dorricott Metrics and Process Improvement, LTD

Linda B. Sullivan, Co-Founder & President,
Metrics Champion Consortium

Click here to submit a question