All blueprints

Every control linked to its evidence.

Quality risk management for ICH Q9(R1) and ISO 14971 that links each scenario and control to its verification and to the complaints and deviations that test it. Neil prepares the follow-up; your team decides the risk.

Illustration of a seal beside an open evidence folio containing SOP, training and execution records.
Verification › VER-021

High-level stop test

  • Sensor (met)Tripped
  • Command (met)Close sent
  • Inlet (not met)Remained open
Risk controls › CTRL-021
not verified
Scenario
Vessel overfill
Requires
Inlet closes
Evidence
VER-021 failed
Assessments › RSK-021
review open

Vessel overfill

  • Investigation (met)Opened
  • Retest (not met)Required
  • Acceptance (not met)Not decided

Figure 1. VER-021 fails because the inlet stays open, so CTRL-021 is not verified and its risk review is open again.

Summary

The problem
Risk files are maintained apart from the tests, complaints and deviations that should change them, so estimates outlive the evidence behind them.
Seal’s approach
A failed verification, complaint or maintenance finding links to the scenario and control it challenges, and the original observation stays intact.
Neil
Seal’s AI agent investigates a challenged control, compares new evidence with the assumptions in the file and drafts the next verification. Your team makes the risk decision. About Neil.
What changes
Estimates keep their denominator. The population, observation period and uncertainty travel with each rate, so fewer failures are not mistaken for less risk.
Where to start
One risk file and a recent piece of evidence that challenges it. Book a demo.

A traditional eQMS files the risk assessment. Seal links it to the evidence.

A traditional eQMS is a system of record. It keeps the risk assessment as a controlled document: the hazards, the scores and the controls meant to reduce them. The evidence that a control works, and the complaints and deviations that should change an estimate, sit in other records.

A traditional eQMSSeal
Control claimNamed in the assessmentLinked to its tested result
VerificationA document referenceExpected and observed results
Failed checkA note for the next updateChallenges the linked assessment
New evidenceRead at the next reviewLinked to the scenario it tests
EstimatesA score or a countKept with population and period
Follow-upAn action itemOwned work and a verified change
EffectivenessA closed actionReviewed on later evidence
AIText to paste elsewhereNeil prepares the follow-up
Getting startedA replacement projectOne risk file, beside your eQMS

A named control is not evidence that it works. The claim rests on verification evidence, which usually sits somewhere else: a test record, a maintenance log, a spreadsheet. When the two drift apart, the file keeps asserting a control that nobody has shown to work. Seal links the risk file to the controls as they are configured and tested, so a failed verification or new complaint challenges the assessment it concerns, and a strengthened control is verified before the assessment relies on it.

ICH Q9(R1) sets two principles for quality risk management: the evaluation of risk to quality is based on scientific knowledge and ultimately links to the protection of the patient, and the level of effort, formality and documentation is commensurate with the level of risk.¹ For medical devices, ISO 14971 asks manufacturers to identify hazards, estimate, evaluate and control the risks, and monitor the effectiveness of the controls, across every phase of the device’s life cycle.² Both depend on evidence that a document cannot keep current by itself.

Figure 1 follows CTRL-⁠021, a fictional high-level stop that should close a vessel’s inlet valve before it overflows. Its verification, VER-⁠021, failed: the sensor tripped and the close command was sent, but the inlet remained open. The failure leads back to the control, the scenario it serves and the risk review it reopens. The sections below follow CTRL-⁠021 from the failed test to a strengthened control, with a complaint and a CAPA trend as the evidence that reaches the file from outside.

You can start with one risk file, alongside the eQMS you already run: Seal connects to the documents, CAPAs and change controls in systems such as Veeva Vault QMS, MasterControl, Qualio and ETQ Reliance. The advantage grows as quality, manufacturing and laboratory work run on the same connected records, because the evidence that tests a control is then recorded where the control runs.

Follow the failure back to the control.

The scenario, the control requirement, the tested configuration and the verification result point to one another. A failed test leads back to the control, the requirement it serves and the investigation needed next, without anyone reconciling references across spreadsheets.

VerificationWhat it showsWhat stays open
Not recordedNothing about the controlExecution and the review
FailedThe required response failedInvestigation and retest
PassedThe tested response occurredThe residual-risk decision

In Figure 1, CTRL-⁠021 should close the inlet valve when the high-level sensor trips. VER-⁠021 records the required response, the inlet closes, beside the observed one, the inlet remained open. Link the failed result to an investigation and the affected control. Assess the cause and define the verification needed after the change.

Keep the original observation. An investigation can change the explanation or the proposed control; it should not rewrite what happened in the test. Retain the failed result and the tested configuration, and review the residual risk separately. Reviewers decide which checks must be repeated and whether the remaining risk is acceptable.

A missing result is not a pass. Without a recorded execution, the control’s effectiveness is not established and the risk review stays open. A passing result is evidence, not risk acceptance: review the test scope, the other controls and the remaining uncertainty, and record the residual-risk decision separately. ICH Q9(R1) treats risk acceptance as its own decision, made case by case, and notes that a risk reduction measure can introduce new risks, so the assessment may need revisiting after it is implemented.¹

New evidence can challenge an old assumption.

A complaint, maintenance finding or production deviation may change the basis of a risk assessment. Connect the source to the affected scenario and retain why it belongs in the review.

INT-031 keeps the reporter’s wording and leaves the device identity and both assessments open, in Seal with fictional records
Figure 2. INT-⁠031 keeps the reporter’s wording and leaves the device identity and both assessments open

This related complaint separates the original report from the technical investigation and the safety assessment. INT-⁠031 records the reporter’s words, “The device stopped during use. The patient needed assistance. We no longer have the packaging.” The lot and serial number were not supplied, and the technical and safety assessments remain open. A reported malfunction is evidence to assess, not a confirmed cause or a risk conclusion.

Preserve the source wording and distinguish reported facts from conclusions. Give each unresolved question an owner, a source and a follow-up: INV-⁠031 asks what happened to the device during the reported use, and what evidence is needed before anyone draws a conclusion. Link it to the scenarios it may challenge, and record why each source was included in the review or left out. A similarity is not a confirmed cause.

ICH Q9(R1) asks for a mechanism to review or monitor events, and for the output of risk management to be reviewed against new knowledge and experience, whether the event is planned, such as a product review, an audit or a change, or unplanned, such as the root cause of a failure investigation or a recall. The frequency of review follows the level of risk, and a review may reconsider an earlier acceptance decision.¹ Configure the owners and the review triggers for each source of evidence, so a relevant complaint reaches the assessment rather than waiting for the next scheduled update.

Keep the denominator with the estimate.

Fewer failures do not necessarily mean less risk. Keep the population, exposure, observation period and uncertainty with each estimate, so a falling count is not mistaken for a falling rate.

CAPA-071 compares failures per 100 runs before and after a change: 8.0, then 8.3, in Seal with fictional records
Figure 3. CAPA-⁠071 compares failures per 100 runs before and after a change: 8.0, then 8.3
Before the changeAfter the change
Failures125
Runs15060
Per 100 runs8.08.3

In this related CAPA example, failures fall from 12 to 5, but use falls from 150 to 60 runs. The observed rates are 8.0 and 8.3 per 100 runs. Seal’s configured chart keeps the comparison visible. Assess the population, observation period, uncertainty and competing explanations before using it to revise an estimate. These observations alone do not establish a causal effect.

ICH Q9(R1) asks risk evaluations to consider the strength of evidence, and notes that revealing assumptions and reasonable sources of uncertainty enhances confidence in the output or shows its limitations. Qualitative descriptors such as high, medium and low should be defined in as much detail as possible.¹ ISO 14971 requires objective criteria for risk acceptability but does not set the acceptable levels.²

Configure the categories, definitions and criteria for your context, and record their version and the basis for each estimate, so reviewers can see what an assigned value means. Apply the criteria without turning incomplete counts into incidence claims.

Formality follows the risk.

ICH Q9(R1) treats formality as a continuum: higher uncertainty, importance or complexity call for more formal risk management, and resource constraints do not justify less.¹ Use a distinct template for each method your process needs.

MethodUsed forWhat it holds
ISO 14971 risk fileMedical devicesPlan, scenarios, controls, review
ICH Q9 risk assessmentA quality questionMethod, evidence, control, review
Process FMEAProcess stepsFailure modes, causes, controls
Rule-based decisionLimits set in a workflowThe rule version and its outcome

Methods can share records. A device risk file, a pharmaceutical quality risk assessment and a process FMEA can reference common functions, controls, requirements and source evidence while keeping their own terminology and assessment criteria. ICH Q9(R1) lists tools from FMEA, FMECA and fault tree analysis to HACCP, HAZOP, preliminary hazard analysis and risk ranking and filtering. It also describes rule-based decisions, where an SOP or a well-understood limit determines the action without a new assessment, which is how a limit configured in a workflow routes an exception.

Subjectivity enters through poorly defined risk questions and poorly designed scoring scales; ICH Q9(R1) asks for it to be managed by addressing bias and assumptions, using the tools properly and making the most of relevant data.¹ Versioned criteria and the basis recorded with each estimate give reviewers something to challenge.

A shared product-family control does not cover every product automatically. Keep its applicability, configuration and supporting evidence explicit for each assessed scope. The shared reference helps identify the affected products; reviewers decide whether the evidence applies.

Neil prepares the work. Your team decides the risk.

Neil is Seal’s AI agent. Give it the risk file, the changed requirement or the new evidence; it investigates the records the requester is permitted to see and prepares assessments, verification cases and workflow changes as work in Seal.

Neil preparesYour team decides
ImpactLinked scenarios, with sourcesThe scope of the review
CauseCompeting explanationsWhich one the evidence supports
VerificationCases, including failure pathsExecution and the result
EstimatePopulation and exposure limitsWhether the estimate changes
RiskThe open questionsWhether the risk is acceptable
Risk controls › CTRL-021

VER-021 failed. Find what relies on CTRL-021 and prepare the next verification.

Neil

  • RSK-021 and the requirement CTRL-021 serves, with sources.
  • The tested and current configurations compared.
  • Two explanations, and the evidence that separates them.
  • Cases for a trip, a sensor fault and no close command.
  • The residual risk left open for review.
  • Draft (met)Ready to inspect
  • Verification (not met)For your team
  • Risk decision (not met)For your team
Figure 4. Neil prepares the follow-up to VER-⁠021 and leaves verification and the risk decision to your team

To investigate a challenged control, ask Neil to find the requirements and scenarios linked to the failed verification and to compare the tested configuration with the current one. It prepares a proposed impact assessment with source versions, competing explanations and the evidence needed to distinguish them. Missing evidence becomes linked follow-up work.

To prepare the next verification, ask it to turn the proposed control change into requirements, capture fields and verification cases. It drafts inspectable configuration and cases covering the intended response, the failure paths and missing evidence, including verification of the configured workflow itself before publication.

To review the operating evidence, ask it to compare the relevant complaints and service findings with the assumptions in the risk file. It prepares a source-linked comparison with population and exposure limits, candidate affected scenarios and proposed review tasks, without an unsupported incidence estimate or an automatic risk acceptance.

The useful deliverable is inspectable work: source-linked reasoning, explicit gaps and a proposed change your team can test. People approve the technical scope, run verification and make the risk decision.

In line with the EU’s draft GMP Annex 22 on AI, Neil is not used in GMP execution. It helps set up configuration, which your team verifies and releases under change control. Customer data is not used to train AI models, and the requester’s permissions govern what Neil can read. See how Neil fits Annex 22 and more about Neil.

A stronger control goes through change control.

When the investigation points to a better control, a change carries it: the revised requirement, the instructions, capture fields and qualifications that depend on it, and the verification the assessment will rely on. Approval, verification and the effectiveness review remain separate decisions.

CHG-014, a related change, links a procedure to the qualification, form and line-side copy it affects, in Seal with fictional records
Figure 5. CHG-⁠014, a related change, links a procedure to the qualification, form and line-side copy it affects

Follow a changed requirement into the instructions, capture fields, qualification and verification that depend on it, and record the assessment scope and rationale. CHG-⁠014 shows the same mechanism on a related line-clearance change: one added instruction reaches an execution form, a qualification and a controlled copy, each with an owner and the evidence needed to close it. For CTRL-⁠021, the change would carry the revised control and the cases its retest must pass before RSK-⁠021 relies on it.

EU GMP asks for quality risk management to be used to evaluate planned changes, including their effect on validation, calibration and maintenance, and to plan the verification or requalification they need.³ ICH Q9(R1) counts change control among the planned events that send a risk decision back for review.¹ See change control for how the revision, its verification and its effective point are handled.

Define which evidence will test the improvement, and when, before it is implemented. Keep completion of the work separate from the later assessment of whether the change helped. A completed action does not close the risk review: review the implementation, the verification, the remaining uncertainty and any required effectiveness evidence before recording the authorised conclusion.

Start with one risk file.

Bring one risk file and a recent piece of evidence that challenges it: a failed verification, a complaint or a deviation.

Neil prepares the impact assessment, the follow-up work and the verification cases from that material, and your team inspects them against the risk file and the evidence. Start with sample material or arrange an NDA before sharing confidential records.

Test the cycle before you rely on it: a missing result, a failed verification and its retest, a complaint that may or may not belong to a scenario, a changed estimate with its denominator, and the residual-risk decision that follows.

Seal can run beside the eQMS you already use. Agree which system owns the risk file, which records Seal reads and how status crosses the boundary. To scope the first risk file with us, book a demo.

References

  1. 1ICH Q9(R1), Quality Risk Management (2023), sections 3 (principles), 4.3 (risk assessment: strength of evidence, assumptions, uncertainty and qualitative descriptors), 4.4 (risk control and risk acceptance), 4.6 (risk review), 5 (tools), 5.1 (formality), 5.2 (rule-based decisions) and 5.3 (subjectivity). ICH
  2. 2ISO 14971:2019, Medical devices — Application of risk management to medical devices, clause 1 (scope): a process to identify hazards, estimate, evaluate and control the risks and monitor the effectiveness of the controls, applicable to all phases of the life cycle; it requires objective criteria for risk acceptability but does not specify acceptable risk levels. ISO
  3. 3EudraLex Volume 4, Annex 15, Qualification and Validation (2015), section 11.4 (change control): quality risk management used to evaluate planned changes, including their impact on validation, calibration and maintenance, and to plan the validation, verification or requalification they need. European Commission

AConnected records

Entity
What it records
Kind
Hazard
Potential source of harm, with its product or process context and supporting evidence.
type
Energy Hazard
Electrical, mechanical, thermal or radiation energy whose transfer can cause harm.
template
Biological Hazard
Biocompatibility, infection or contamination arising where the device contacts the body.
template
HAZ-017
Fictional reprocessing scenario: surface geometry may retain contamination and needs assessment.
instance
Use Error
Foreseeable misuse, abnormal use or use-environment factors, such as a user unable to apply the force a design assumes.
template
Risk
Assessment of a scenario using the defined criteria, evidence and uncertainty.
type
RSK-021
Fictional vessel-overfill assessment, open again after VER-021 failed. The retest and the residual-risk decision are still to come.
instance
Risk Control
Measure intended to reduce risk, linked to its requirement and verification.
type
Design Control
Design measure intended to reduce risk, with its rationale and verification scope.
template
CTRL-001
Fictional time-based stop requirement. Implementation, operating conditions and evidence require review.
instance
Protective Measure
Protective measure such as a guard, alarm or interlock, with a defined response and evidence.
template
CTRL-021
Fictional high-level stop: the inlet valve closes when the vessel’s high-level sensor trips. Not verified while VER-021’s failure is investigated.
instance
Information Control
Information for safe use, with its intended audience, scope and assessment of limitations.
template
Residual Risk
Assessment of the risk remaining after controls, with rationale and required review.
type
Post-Market Data
Operating evidence that may support or challenge the assumptions in the risk file.
type
FMEA
Analysis of functions, failure modes, effects, causes and controls within a defined scope.
type
Process FMEA
Process-step functions, failure modes, effects, causes, existing controls, estimates, actions, verification and residual decisions.
template
Risk Management Plan
Scope, lifecycle, roles, activities, methods, criteria, verification, information sources, review, deliverables and change triggers.
type
ISO 14971 Risk File
Medical-device lifecycle plan, analyses, scenarios, controls, verification, residual and overall risk, report and post-production review.
template
ICH Q9 Quality Risk Assessment
Pharmaceutical quality question, risk method, evidence, analysis, control, communication, review and formality proportional to risk.
template

BQuestions and answers

Does Seal decide whether a risk is acceptable?

No. Your team defines the criteria, context and required review. Seal holds the versioned assessments, evidence and decisions; a passing verification does not itself accept residual risk.

Can different risk methods share records?

Use distinct templates for the methods your process needs. They can reference common functions, controls, requirements and source evidence while retaining their own terminology and assessment criteria.

What happens when verification fails?

Retain the failed result and tested configuration. Link the investigation and proposed correction to the affected control, then define the verification needed after the change. Review the residual risk separately.

Can we use our own scales and risk matrix?

Configure the categories, definitions and criteria for your context. Record their version and the basis for each estimate so reviewers can understand what the assigned values mean.

How does new operating evidence reach a review?

Link relevant complaints, deviations or service findings to the assessment. Configure ownership and review triggers, and retain why each source was included or excluded. A similarity is not a confirmed cause.

What can Neil prepare?

Neil can analyse supplied documents and permitted records, prepare source-linked assessments and follow-up work, and author proposed requirements, capture fields and verification cases. People verify the configuration and approve the decisions.

Does a shared product-family control cover every product?

Not automatically. Keep the applicability, configuration and supporting evidence explicit for each assessed scope. A shared reference helps identify the affected products; reviewers determine whether the evidence applies.

Does Seal support ICH Q9(R1) and ISO 14971?

Use an ICH Q9 quality risk assessment template for a pharmaceutical quality question and an ISO 14971 risk file for a medical device. They can share controls, requirements and source evidence while keeping their own criteria. Your team sets the formality each assessment needs and makes the acceptance decision.

Can a completed action close the risk review?

Action completion and risk acceptance are different decisions. Review implementation, verification, remaining uncertainty and any required effectiveness evidence before recording the authorised conclusion.

Capabilities

See your process in Seal.

Bring a procedure or a recurring problem. See how your team can use Neil to configure the workflow, investigate the results and improve the next version.

Book a demo