Do you have a question about the MDR, Clinical Evaluation, PMS, PMCF, CER, deficiencies, or technical documentation?
Simply submit your question anonymously using the form below. Dr. Leistner will answer selected questions on this page with clear, practical, and scientifically sound explanations.
Your question will remain anonymous.
You only need to provide your email address if you would like to be notified when an answer has been published.
Describe your question as clearly and specifically as possible. The more details you provide, the more helpful and relevant the answer can be.
Your question will be published without your name or any personal information. Please do not include any confidential company, product, or patient information in your question.
Selected questions are answered regularly on this page. If you would like, we can notify you by email as soon as an answer to your question has been published.
Hello Dr. Zommer Team,
I am currently preparing our SSCP and do not fully understand the section on “Quantitative Data.”
Answer:
Hello,
This is another interesting topic because it represents an important connection between different processes and documents within medical device documentation. Let’s go through the entire section step by step.
The passage in MDCG 2019-09 SSCP – Section 4.1 Quantitative Data begins with:
“The definition of risk includes the probability of occurrence of harm. Therefore the information in the SSCP on risks shall also include quantifications. This information can be sourced from the clinical evaluation report where an updated examination of qualitative and quantitative aspects of clinical safety is available, with clear reference to the determination of residual risks and side-effects.”
This passage explains that a SSCP (Summary of Safety and Clinical Performance) should include quantitative information because, by definition, the concept of risk includes the probability that harm may occur.
It also states that this information should be taken from the Clinical Evaluation Report (CER), which should contain both qualitative and quantitative assessments of clinical safety.
This is a very abstract and complex statement. Hidden within it is a reference to the benchmarking process in the CER. The Clinical Evaluation establishes quantitative acceptance criteria for safety. One example could be the complication rate of medical devices used during surgical procedures.
In another Dr. Zommer article, I discuss benchmarking in Clinical Evaluation in greater detail, so you may also want to take a look at that topic.
Let’s now examine the next section:
“It should also be clarified in the SSCP whether quantitative data on side effects or residual risks relate to clinical data that were obtained proactively, for example from a structured prospective follow-up study of the device itself, or if the expected frequencies come from a systematic review of the scientific literature. It should be disclosed in the SSCP if data from spontaneously reported incidents or serious incidents are used as one of the sources for estimating quantitative data on side-effects or residual risks, in which case significant under-reporting needs to be considered.”
The SSCP should explain the source of the quantitative data and whether the data were collected by the manufacturer through a clinical investigation or obtained from a literature review.
If the data are not collected proactively but instead originate from incident reports or other safety data sources, the possibility of underreporting must be considered.
Clinical study data are collected proactively and systematically because documentation is integrated into the study process and reporting requirements are mandatory for study participants and investigators.
Incident reporting, on the other hand, does not involve a systematic assessment after every use or application of a device to determine whether an issue occurred. Only reported incidents are captured.
As a result, the number of documented incidents may be lower than the actual number of events that occurred. Therefore, rates and probabilities derived from such data have limitations and must be interpreted while considering the possibility of underreporting.
Practical Tip
Separate your quantitative data into Clinical study data and PMS data. The benchmarks for the clinical study data can be derived from the CER (see the corresponding Dr. Zommer article on benchmarking).
The PMS data and associated probabilities can be derived from your trend reporting according to Article 88, as this process specifically focuses on the occurrence frequencies observed during Post-Market Surveillance.
The guidance continues:
“A relation to time should also be included when presenting the quantitative data, for example during five or ten years of use from implantation, or adverse events per 100 patient-years for implantable devices with constant hazards, etc. The quantitative data and the relation to time should always be presented together.
To use tabulated lists for the presentation of side-effects and residual risks with quantitative data and a relation to time, may enhance the readability.”
To make meaningful statements about the probability of occurrence, the rates must always be linked to a specific time period.
Examples for devices used during surgical procedures could include:
This approach can be applied effectively to both clinical study data and PMS data.
The last part of the guidance states:
“In the part of the SSCP that is intended for patients, residual risks and side-effects should be explained and quantified in a way that patients and lay persons can understand. A statement should be included about how potential risks have been controlled or managed, and also a statement on what to do if the patient believes that he/she is experiencing side-effects related to the device or its use.”
This section is largely self-explanatory.
The objective is to ensure that patients and other laypersons can understand how the information is presented. They should also receive clear guidance on what actions to take if they believe they are experiencing side effects related to the medical device or its use.
Conclusion
A well-structured Clinical Evaluation and robust documentation of trend reporting in accordance with Article 88 are important prerequisites for fulfilling these SSCP requirements. The inclusion of a clear time reference for quantitative data and a patient-friendly presentation of the information are equally important.
I hope this helps clarify the topic and answers your question.
Dear Dr. Zommer Team,
My consultant told me that I need clinical data for all indications and target patient populations. However, I cannot find any clear reference to this requirement in the MDR.
Answer:
Yes, that is actually correct. However, the MDR does not state this requirement explicitly, but rather implicitly, which is why it can easily be overlooked at first.
Let’s take a closer look together.
In Annex XIV, Part A of the MDR, it is required that the Clinical Evaluation Plan contains a: “precise specification of the intended target groups with clear indications and contraindications.”
At this point, the requirement is simply that the patient populations and indications are clearly defined.
The requirement for clinical data becomes apparent a few points later within the same section. It states that the plan must also include: “a non-exhaustive list and specification of parameters to be used to determine, based on the current state of the art in medicine, the acceptability of the benefit-risk ratio for the various indications and for the intended purpose or purposes of the device.”
If you are having difficulties with benchmarking, you may also want to look at the other Dr. Zommer questions. Benchmarking is discussed in a separate article as well.
This means that benchmarks must be established to validate the benefit-risk ratio. The MDR explicitly requires this to be done for the different indications. From this requirement, it can be concluded that clinical data should also be available for all indications in order to compare them against the defined benchmarks.
Although the target patient population is not explicitly mentioned here, the same conclusion can be drawn from this requirement. The benefit-risk ratio must be acceptable for the various intended purposes. This means that it must be demonstrated that the device is safe and performs as intended in all intended uses, and therefore also within every patient population. Since this demonstration can only be achieved through clinical data, clinical data should also be available for each patient population.
This interpretation is also reflected in MDCG 2020-13. The assessment template used for reviewing Clinical Evaluations explicitly asks in Section E whether clinical data exists for the intended patient population: “Who is the intended patient population? Does the clinical evidence support this?”
Further conclusions can be drawn from MDCG 2020-1, the guidance document on the Clinical Evaluation of software-based medical devices. Although the document focuses on software, the underlying principles can be applied to all medical devices.
In Section 4, within the discussion of Clinical Performance, the guidance directly asks whether all indications and target populations are supported by clinical data: “Does the data support the intended use, indications, target groups, clinical claims and contraindications?”
In the Background section, the following statement can also be found: “Each indication and claimed CLINICAL BENEFIT that is part of the intended purpose should be assessed individually and have the supporting CLINICAL EVIDENCE.”
This clearly demonstrates that each indication must be assessed individually. The same principle is reflected in the requirements for the Summary of Safety and Clinical Performance (SSCP).
MDCG 2019-09, which provides guidance on the SSCP, states the following in Section 5, “The summary of clinical evaluation as referred to in Annex XIV, and relevant information on post-market clinical follow-up”: “A description of the benefit-risk assessments related to safety and performance for each indication claimed by the manufacturer, including information to address benefit-risk issues of interest to specific patient populations, if applicable.”
At the latest, when preparing the SSCP, it becomes apparent that the clinical data should cover all indications and target patient populations.
Practical Tip
Present your clinical data in a structured manner according to indications and target populations. This provides a clear overview and makes it immediately obvious that supporting evidence exists for all intended uses and patient groups.
What If There Is Not Enough Clinical Data?
If there is insufficient clinical data to demonstrate safety and performance for all indications and target populations, the corresponding claims must be restricted.
This requirement is stated very clearly in MDCG 2020-6 (Section 6.5 e). Although this guidance focuses on the clinical evidence requirements for legacy devices, the principle applies to all medical devices: “If there is not sufficient supportive clinical evidence with regard to the declared intended purpose including the indications and claims as appropriate, manufacturers shall narrow the intended purpose of the device under evaluation until it is supported by the available clinical evidence.”
In other words, if the available clinical evidence does not adequately support all intended indications, claims, or patient populations, the intended purpose must be narrowed until it is fully supported by the available clinical data.
I hope this answers your question and provides some guidance on how to interpret these requirements.
Dear Dr. Zommer Team,
I’m wondering why Similar Devices play such an important role in the Clinical Evaluation. We have our own clinical data and no equivalent devices, so why do we still need to identify Similar Devices? The MEDDEV and the MDR hardly mention Similar Devices at all.
Answer:
What Are Similar Devices and Why Are They Needed?
That is correct. In MEDDEV 2.7/1 Rev. 4, which is still partially relevant, the term “Similar Device” appears only twice, and the term is also not mentioned in Annex XIV of the MDR.
At first glance, there also seems to be no specific guidance on Similar Devices. Somewhat unexpectedly, however, relevant information can be found in MDCG 2020-5: Clinical Evaluation – Equivalence; A Guide for Manufacturers and Notified Bodies.
Definition: What Are Similar Devices?
This guidance also provides a definition of Similar Devices:
“The term ‘similar devices’ may be understood as devices belonging to the same generic device group. The MDR defines this49 as a set of devices having the same or similar intended purposes or a commonality of technology allowing them to be classified in a generic manner not reflecting specific characteristics”
MDCG 2020-05
Section 5, Use of Similar Data, explains how data from Similar Devices can be used.
What Are Similar Devices Used For?
According to the guidance, data from Similar Devices is relevant for the following purposes:
MDCG 2020-05
Although this guidance is not legally binding, many Notified Bodies treat it as an expected requirement.
What Information About Similar Devices Should Be Included?
Now that we understand what Similar Devices are and why they are used, it is equally important to understand what information should be documented about them.
The first indications can be found in MDCG 2020-13: Clinical Evaluation Assessment Report Template.
In Section C – Previous Generations of the Device and Similar Devices (if applicable), the guidance includes the following instruction:
“Verify that the manufacturer has provided:
MDCG 2020-13
Initially, this requires a general overview of Similar Devices together with relevant market information.
Additional guidance can be found in MDCG 2020-7: Post-Market Clinical Follow-up (PMCF) Plan Template; A Guide for Manufacturers and Notified Bodies.
Although this document focuses on the PMCF Plan, it provides valuable insight into the information that Notified Bodies consider relevant regarding Similar Devices and which therefore should also be included in the Clinical Evaluation.
According to Section E, the following information should be provided for each Similar Device, preferably in tabular format:
The following items of each equivalent and/or similar devices would be at least provided, in a table format:
MDCG 2020-7
How Is the Use of Similar Devices Implemented in Practice?
We now have the basic framework and understand both the required information and the role that Similar Devices play in the Clinical Evaluation.
As mentioned above, MDCG 2020-5 describes the purposes for which Similar Device data can be used. MDCG 2020-13 further explains how this can be implemented.
Connection to Risk Management
Section C of MDCG 2020-13, under Safety, states:
“ If relevant, briefly summarise any significant complaint, trends or vigilance issues associated with earlier device iterations, which may be equivalent or similar devices, and explain whether or not they have any impact on the clinical evaluation assessment.”
MDCG 2020-13
This directly relates to the first purpose described in Section 5 of MDCG 2020-5:
“Ensuring that the risk management system is comprehensive by identifying relevant hazards and clinical risks.”
Connection to the State of the Art
Similar Devices also play a role within the State of the Art section.
The guidance states:
“Briefly describe how benchmarks for safety and performance have been identified by the manufacturer in terms of the state of the art. Benchmarks will normally be based on aggregate data from several devices considered to have acceptable performance (e.g. systematic reviews or registry analysis); if individual devices are selected as benchmarks for safety and performance, a suitable rationale should be provided.”
MDCG 2020-13
This directly supports the final two purposes described in MDCG 2020-5:
Practical Tip
This is how we implement Similar Device analysis in our Clinical Evaluations, and the approach has proven successful in numerous MDR conformity assessments for a wide variety of medical devices and Notified Bodies.
In addition to performing a structured State of the Art (SOTA) search, we also conduct a dedicated Similar Device search.
First, we introduce the identified Similar Devices within the Clinical Evaluation together with the information described above. We then search for each product’s trade name in two scientific literature databases.
The searches are performed without applying filters, ensuring that no potentially relevant data is excluded and that every possible residual risk can be identified.
We also search the same trade names in all relevant safety databases.
Ideally, this includes the safety databases of every country where the Similar Devices are marketed. Since the countries of sale are not always fully known, we alternatively search the safety databases of the countries in which the device under evaluation is marketed.
All identified incidents, field safety corrective actions, recalls, and other relevant safety information are incorporated into our safety analysis and compared against the risk management documentation and the Instructions for Use (IFU).
I hope this provides a helpful initial overview.
Otherwise, I would be delighted to welcome you to the next Q&A Session on 7 September, where I can explain the topic in more detail.
Dear Dr. Zommer Team,
I received the following deficiency and I’m not quite sure how to address it:
“No benchmark values for the missing outcome parameters have been identified for either of the listed indications.”
How should I approach this?
Answer:
What Are Threshold Values and Benchmarks?
There are several terms used for this concept, such as benchmarks or acceptance criteria. Some readers may also be familiar with the concept of threshold values from technical validation.
In general, the purpose is to define the criteria that must be met to demonstrate the safety and performance of a medical device.
In the context of a Clinical Evaluation, this specifically means defining the clinical safety and performance values that the device is expected to achieve. These target values should be derived from the State of the Art (SOTA) section of the Clinical Evaluation.
An Example: Bone Implants
There are also several terms used for the measurement itself, including Clinical Outcome Parameter, Clinical Endpoint, and their respective translations.
Typical clinical endpoints for implants include:
If we use complication rate as an example, a threshold value could be:
Complication rate below 3% after 6 months
It is important to remember that threshold values must always consist of a measurable clinical parameter combined with a specific numerical value.
Regulatory Requirements for Benchmarking
A useful starting point is Annex XIV of the MDR, which outlines the required contents of the Clinical Evaluation Plan (CEP).
The Clinical Evaluation Plan must include, among other things:
From the perspective of the Clinical Evaluation, these are highly demanding requirements for the CEP.
The concept of benchmarking is embedded within the requirements concerning:
A more explicit reference can be found in MDCG 2020-13 – Clinical Evaluation Assessment Report Template:
“Briefly describe how benchmarks for safety and performance have been identified by the manufacturer in terms of the state of the art. Benchmarks will normally be based on aggregate data from several devices considered to have acceptable performance (e.g. systematic reviews or registry analysis); if individual devices are selected as benchmarks for safety and performance, a suitable rationale should be provided.”
This guidance clearly states that benchmark values must be derived from the State of the Art (SOTA). Ideally, these benchmarks should be based on aggregated data from several Similar Devices, rather than relying on a single device whenever possible.
Stay informed.
The data you enter here will only be used to personalize the newsletter and will not be passed on to third parties. You can unsubscribe from the newsletter at any time or revoke your consent at any time by sending an email to info@mec-abc.de. Your data will be deleted within 1 month after you stop receiving the newsletter, provided that there are no statutory retention obligations to the contrary. By sending the data you have entered, you consent to the data processing and confirm our privacy policy.
If you cannot find the e-mail in your inbox, please also check your spam folder.
Stay informed.
The data you enter here will only be used to personalize the newsletter and will not be passed on to third parties. You can unsubscribe from the newsletter at any time or revoke your consent at any time by sending an email to info@mec-abc.de. Your data will be deleted within 1 month after you stop receiving the newsletter, provided that there are no statutory retention obligations to the contrary. By sending the data you have entered, you consent to the data processing and confirm our privacy policy.
If you cannot find the e-mail in your inbox, please also check your spam folder.
Das Template-Paket Klinische Bewertung ist für Sie jetzt zum Angebotspreis in limitierter Auflage verfügbar.
Sichern Sie sich unsere Whitepaper zu “Anforderungen der MDR” und “Übersicht über die Konformitäts-Bewertungsverfahren”.
You are currently viewing a placeholder content from Vimeo. To access the actual content, click the button below. Please note that doing so will share data with third-party providers.
More InformationYou are currently viewing a placeholder content from YouTube. To access the actual content, click the button below. Please note that doing so will share data with third-party providers.
More InformationYou need to load content from reCAPTCHA to submit the form. Please note that doing so will share data with third-party providers.
More InformationYou are currently viewing a placeholder content from Facebook. To access the actual content, click the button below. Please note that doing so will share data with third-party providers.
More InformationYou are currently viewing a placeholder content from Google Maps. To access the actual content, click the button below. Please note that doing so will share data with third-party providers.
More InformationYou need to load content from hCaptcha to submit the form. Please note that doing so will share data with third-party providers.
More InformationYou need to load content from reCAPTCHA to submit the form. Please note that doing so will share data with third-party providers.
More InformationYou are currently viewing a placeholder content from Turnstile. To access the actual content, click the button below. Please note that doing so will share data with third-party providers.
More Information