All blueprints

Know exactly what your audit evidence contains.

GxP audit and inspection management software that pins the source version behind each piece of evidence and links findings to their assessment, change and verification. Neil assembles the evidence and the gaps for your team to review.

Illustration of a seal beside an open evidence folio containing SOP, training and execution records.
Audits › AUD-014

Batch review

Focus
Evidence retrieval
Sample
B-041, B-044, B-047
Lead
Internal audit
Packages › PKG-014
v2
  • B-041 (met)v1 kept; v3 since
  • B-044 (met)v1
  • B-047 (not met)Source missing
Follow-up › AUD-014
4 open
Source
Batch record owner
Gap
Audit lead
Change
Quality systems
Verify
Independent reviewer

Figure 1. AUD-014 samples three batch reviews; the package keeps their versions, and the gap becomes owned work.

Summary

The problem
Audit preparation starts from a blank checklist, and findings become tasks that can be closed without showing that the underlying question was answered.
Seal’s approach
Each engagement holds its focus, scope, evidence requests and the reasons for them. Evidence is the source record at the version selected, not a copy in a binder. A finding links its assessment, proposed change and verification, each with its own owner and state.
Neil
Seal’s AI agent assembles the candidate evidence at its versions, drafts requests for what is missing and traces recurring findings. Your team decides what is disclosed and what the cause is. About Neil.
Evidence
Acclinate spends 40% less time preparing for audits, and shows its customers’ auditors approval histories, training records and access controls directly from Seal.
Where to start
One upcoming audit: its scope, the relevant procedures and the records you can already access. Book a demo.

A binder copies the evidence. Seal opens the record.

A traditional eQMS is a system of record. Its audit module schedules the audit, files the report and tracks each finding as a task, while the evidence is exported from the batch, training and equipment systems into a binder or a shared folder and checked by hand for version and completeness.

A traditional eQMSSeal
ProgrammeA schedule of datesScoped from risk and past findings
EvidenceExports in a binderLinked records at a pinned version
Later revisionsFound by checking by handFlagged on the selected version
Missing evidenceA note in the reportAn open request with an owner
FindingA task to closeAssessment, change and verification
CAPAA separate recordLinked to the finding and the work
EffectivenessA closed taskTested on the records that follow
AIText to paste elsewhereNeil prepares evidence and gaps
Getting startedA replacement projectOne audit, beside your eQMS

A copy cannot say which version of a record it came from, or that the record has changed since. So each audit starts again from a blank checklist or last year’s agenda, and a finding closes when its tasks do, whether or not the question behind it was answered.

In Seal the evidence is the record itself. The audited batches, deviations, changes and training share one record, so a package references each source at the version selected for it, with its history, rather than a copy made for the audit. A gap is an open request with an owner. A finding links its assessment, the change it leads to and the verification, and the corrective action can change the workflow that produced the gap instead of adding a note to a procedure.

Figure 1 follows internal audit AUD-⁠014, which samples batch reviews B-⁠041, B-⁠044 and B-⁠047. Package PKG-⁠014 keeps B-⁠041 and B-⁠044 at the version selected, v1, although B-⁠041 has since been revised to v3. B-⁠047’s review evidence has not been supplied, so the gap becomes owned work, and the audit’s follow-up runs as four records: obtain the source, assess the gap, prepare a workflow change and verify retrieval. The sections below follow AUD-⁠014 from the programme to the effectiveness review.

Acclinate spends 40% less time preparing for audits: the evidence that the right documents were in place and that people were trained on them is produced as part of normal work, so there is less to assemble. When customers audit its quality system, approval histories, training records and access controls are shown directly from Seal. Bioventix, regularly audited by the diagnostic companies that depend on its antibodies, runs its document control, training, audits and CAPAs in Seal.

You can start with one audit, alongside the eQMS you already run: Seal connects to the documents, CAPAs and change controls in systems such as Veeva Vault QMS, MasterControl, Qualio and ETQ Reliance. The advantage grows as quality, manufacturing and laboratory work run on the same connected records: the evidence an auditor asks for is then the record of the work, not a copy assembled for the audit.

Plan each audit from risk and history.

The programme decides what is audited, when and by whom. Base it on risk, earlier findings and what has changed, and keep the reason for each choice, and for any deferral, with the scope.

The audit programme: each engagement has its own focus, window, lead and state, in Seal with fictional records
Figure 2. The audit programme: each engagement has its own focus, window, lead and state

EU GMP asks for personnel, premises, equipment, documentation, production, quality control, distribution, complaints and recalls, and self-inspection itself to be examined at intervals under a pre-arranged programme, in an independent and detailed way, by designated competent people.¹ FDA’s quality systems guidance expects the audit schedule to take account of the relative risk of each activity, the results of previous audits and corrective actions, and the need to audit the complete system.² ICH Q7 asks for regular internal audits to an approved schedule.³

A batch-review audit, a supplier visit and a laboratory audit ask different questions, so they need different scope, evidence and people. Each engagement in Seal records its focus, window, lead and preparation state, and opens into its own scope, agenda and evidence requests. In Figure 2, AUD-⁠014 examines evidence retrieval for batch review, AUD-⁠015 the qualification of a supplier site and AUD-⁠016 access to laboratory methods.

Record the assigned auditor’s competence and independence as evidence in their own right; a name on the schedule establishes neither. The assignment keeps the auditor’s role, qualification and independence, any conflicts or restrictions, and its approval. The FDA guidance also asks that auditors be trained in gathering objective evidence.²

Supplier audits run from the same programme. EU GMP requires audits of the manufacturers and distributors of active substances, with a report that fully reflects what was done and seen and identifies any deficiencies, and further audits at intervals set by quality risk management.⁴ Bring the supplier’s approved scope, changes and unresolved qualification work into preparation, and follow the evidence into the review without treating a supplier’s name as blanket approval. Supplier quality covers the qualification itself.

Client and regulatory audits of your own site run as engagements too. Each request keeps the auditor’s wording, its clarification, owner, priority and due time, the evidence that answers it, and its review and delivery.

Know exactly what the evidence contains.

An evidence package in Seal references each source at the version selected for it. If the source is revised later, the package keeps the version it contained, and replacing it is a separate, reviewed decision.

PKG-014 keeps B-041 and B-044 at v1 and lists B-047 as missing, in Seal with fictional records
Figure 3. PKG-⁠014 keeps B-⁠041 and B-⁠044 at v1 and lists B-⁠047 as missing

When an auditor asks for a batch review, the package should show which version of that record was selected and why. PKG-⁠014 answers request REQ-⁠014 with a targeted sample of three batch reviews. It links B-⁠041 and B-⁠044 at v1. Seal’s version warning on B-⁠041 shows that a newer revision exists, and the package still points to v1. B-⁠047 is listed as missing, with REQ-⁠015 as the open work to obtain it, so the package’s state is incomplete.

B-041 v3 adds the yield reconciliation; its technical review is still open, in Seal with fictional records
Figure 4. B-⁠041 v3 adds the yield reconciliation; its technical review is still open

New evidence belongs to a new source version. Seal’s version comparison sets B-⁠041’s original finding beside the added reconciliation, a reported and reconciled yield of 97.2%, and its technical review is still open. Inspecting that revision does not replace the packaged source. If the team decides v3 belongs in the package, the replacement is reviewed and recorded with its reason.

Keep the request’s exact wording, the selection rule and the specific source versions together. The sample records its population, selection method, strata and any replacements or exceptions, so a reviewer can see why these three batches, and not others, were chosen. In these captures, Published marks a saved version of a record. Technical review, disclosure approval, delivery and audit acceptance are separate decisions.

During a regulatory inspection the same records answer live requests. Inspection readiness covers the request log, the package as delivered and evidence for the date of the work.

Neil prepares the evidence. Your team decides.

Neil is Seal’s AI agent. Bring it the request, the procedure and the records you can access; it locates candidate sources, compares the selected versions with later revisions and prepares linked requests for whatever is still missing. The result is work in Seal, with owners and states the audit team can check, rather than a summary to paste into a response.

Neil preparesYour team decides
EvidenceCandidate sources, with versionsWhat is disclosed
RevisionsLater changes to selected sourcesWhether to replace evidence
GapsRequests for missing sourcesWhether a gap is a finding
RecurrenceEarlier findings, with evidenceThe root cause
WorkflowTemplates, fields and statesWhether it fits the procedure
TestsMissing-source and revision casesExecution and approval
Packages › PKG-014

Find the batch reviews selected for this request. Show the versions and anything still missing.

Neil

  • B-041: v1 selected; v3 since, technical review open.
  • B-044: v1 selected; no later revision.
  • B-047: no review evidence supplied.
  • REQ-015 drafted for the batch record owner.
  • Selection rule kept for disclosure review.
  • Candidates (met)Assembled, with sources
  • Disclosure (not met)For the audit lead
  • Package (not met)For review
Figure 5. Neil assembles PKG-⁠014’s candidate sources and the request for B-⁠047, and leaves disclosure and review to your team

To prepare the evidence response, ask Neil to find the batch reviews selected for the request and show their versions and anything still missing. It assembles the candidate sources, compares the selected revisions with later changes and prepares linked requests for the missing evidence, keeping the selection rationale available for disclosure review.

To investigate a recurring finding, ask it to compare the finding with earlier audits: what recurred, and what would distinguish the possible causes? It traces the findings into their responses and effectiveness records, and prepares an assessment with the evidence for and against each explanation, the gaps to resolve and proposed follow-up work. It does not return a root-cause verdict the evidence cannot support.

To configure the request workflow, ask it to turn your inspection procedure into a reusable evidence-request and review workflow. It authors the templates, capture fields, source references and review states in Seal, and prepares verification cases for a missing source, a changed revision and an unauthorised completion attempt. Your team tests and approves the configuration.

Neil uses supplied documents and permitted records. Proposed records and configuration need review; people authorise disclosure, test changes and approve publication. In line with the EU’s draft GMP Annex 22 on AI, Neil is not used in GMP execution. It helps set up configuration, which your team verifies and releases under change control. Customer data is not used to train AI models, and the requester’s permissions govern what Neil can read. See how Neil fits Annex 22 and more about Neil.

Treat a finding as a question to answer.

A finding is answered when the evidence shows why the gap arose and that it has been fixed, not when its tasks are complete. Keep the source request, the assessment, the change and the verification as separate records, each with its own owner and state.

REQ-015 asks the batch record owner for B-047’s review evidence and links back to the package, in Seal with fictional records
Figure 6. REQ-⁠015 asks the batch record owner for B-⁠047’s review evidence and links back to the package

In the example, B-⁠047 is in the audit sample, but its review evidence has not been supplied. The first step is to obtain the source and establish why it was missing. REQ-⁠015 assigns that to the batch record owner, links back to the package and stays open until the source and its revision are linked, or the reason it is unavailable is recorded and the gap escalated. A request is not evidence. A retrieval problem and a missing technical review are different problems with different fixes, and neither should be recorded as the cause until the evidence supports it.

Establish the condition and its supporting evidence before classifying a finding. An observation records the condition, where it was seen, the evidence and the criterion it is judged against. The finding states the requirement, the scope, its severity and whether it recurs. An observation alone does not establish a root cause.

Four follow-up records for AUD-014, each with an owner, due date and state, linked to PKG-014 v2, in Seal with fictional records
Figure 7. Four follow-up records for AUD-⁠014, each with an owner, due date and state, linked to PKG-⁠014 v2

Seal keeps the source request, the assessment, the proposed change and the verification as separate records linked to the package, each with its own owner, due date and state. Here the batch record owner obtains the source, the audit lead assesses the gap, quality systems prepares the workflow change and an independent reviewer verifies retrieval. The assessment, the change and the verification are still open, and a completed task cannot stand in for an unanswered question.

ICH Q10 expects the CAPA system to take in corrective and preventive actions resulting from audits, regulatory inspections and their findings, with an investigation whose effort is proportionate to the risk.⁵ EU GMP asks for each self-inspection report to contain all its observations and, where applicable, proposals for corrective measures, and for the actions subsequently taken to be recorded too.¹ ICH Q7 asks that findings and corrective actions be brought to the attention of responsible management, and that agreed actions be completed in a timely and effective manner.³

Because findings, responses and source records share one platform, the audit team can follow a finding into the batch record, procedure version or training record it concerns, and into the CAPA it opens. The corrective action can then change the workflow that produced the gap, through change control, instead of adding a note to a procedure.

Close on evidence of effectiveness.

Decide how effectiveness will be shown before an action is called complete, then close on that result. Task completion and effectiveness are separate decisions.

Verify retrieval sets the evidence required before the work can close; it has not started, in Seal with fictional records
Figure 8. Verify retrieval sets the evidence required before the work can close; it has not started

Define the population, selection rule, review period and acceptance criteria for the specific action, then retain the source versions, exceptions and the reviewer’s decision. For the missing batch review, the verification tests retrieval after the approved change against a defined batch population, keeping each source, its version, the retrieval time and any exception, and the results are assessed before the work closes. That might mean sampling later batch reviews and confirming that each can be retrieved at the version the package cites.

ICH Q10 asks for the effectiveness of corrective actions to be evaluated in commercial manufacturing.⁵ FDA’s quality systems guidance expects the managers responsible for the audited areas to resolve findings in good time and to make sure follow-up actions are completed, verified and recorded.²

The follow-up record matters beyond the audit itself. In a routine inspection, FDA’s policy is not to review or copy the reports of a quality assurance programme’s audits; it may instead seek written certification that the audits were implemented, performed and documented and that any required corrective action was taken.⁶ The evidence that your audit system works is the programme, the findings and their verified follow-up, kept where they can be shown.

If a commitment continues beyond audit closure, such as a response promised to an authority or a client, keep its owner, due date, evidence and follow-up visible after the audit record closes. Configure the review and disclosure steps that closure itself requires. In this fictional example, the assessment, change and effectiveness review are still open.

Report the programme to management review.

Management review should see the results of audits and inspections, the commitments made to regulators and whether corrective actions worked. In Seal those are records, so the review reads them from the programme rather than from a summary assembled for the meeting.

Management review asks forRead from
Audit and inspection resultsEngagements and their findings
Commitments to authoritiesCommitments, owners and due dates
Customer auditsClient engagements and responses
Effectiveness of actionsEffectiveness reviews and results
Earlier review actionsFollow-up records still open

ICH Q10 asks for the management review of process performance and product quality to include the results of regulatory inspections and findings, audits and other assessments, the commitments made to regulatory authorities, the effectiveness of changes arising from corrective and preventive actions, and follow-up from earlier reviews. Its review of the pharmaceutical quality system adds self-assessments, including audits, and external assessments such as regulatory inspections and customer audits.⁵ EU GMP expects a process for self-inspection or quality audit that regularly appraises the effectiveness and applicability of the quality system, and a periodic management review with senior management involved.⁷

Repeat findings show where the programme should look next. A finding linked to an earlier audit’s finding and effectiveness review shows whether the earlier action worked. In the connected records of Appendix A, FIND-⁠022 is a major repeat finding for an ineffective periodic access review, and its second effectiveness verification is scheduled after the problem recurred in one department. When the programme itself changes, as AUDIT-⁠PROGRAM v04 did after a supplier-quality signal, the earlier version and the reason for the revision are kept.

Start with one audit.

Bring one real audit request and a small, defined evidence population: its scope, the relevant procedures and the records you can already access.

Neil prepares the candidate evidence, the requests for what is missing and the request workflow from that material, and your team inspects them against how the audit should run. Start with sample material or arrange an NDA before sharing confidential records.

Prove selected versions, a missing source and a reviewed replacement, with the required access and approval steps, before extending the workflow to the rest of the audit schedule. Then follow one finding through its assessment, change and effectiveness review.

Seal can run beside the eQMS you already use. Agree which system owns the audit record, which records Seal reads and how status crosses the boundary. To scope the first audit with us, book a demo.

References

  1. 1EudraLex Volume 4, Chapter 9, Self Inspection: self-inspections monitor the implementation of GMP and propose corrective measures; the listed areas are examined at intervals under a pre-arranged programme (9.1), in an independent and detailed way by designated competent people (9.2), and recorded with all observations, proposals for corrective measures and the actions subsequently taken (9.3). European Commission
  2. 2FDA, Guidance for Industry: Quality Systems Approach to Pharmaceutical CGMP Regulations (2006), section IV.D.2 (conduct internal audits): a planned schedule that takes account of relative risk, previous audits and corrective actions, and the need to audit the complete system; auditors trained in objective evidence gathering; and follow-up actions completed, verified and recorded. FDA
  3. 3ICH Q7, Good Manufacturing Practice Guide for Active Pharmaceutical Ingredients (2000), section 2.4 (internal audits): regular internal audits to an approved schedule (2.40); findings and corrective actions documented and brought to the attention of responsible management, and agreed actions completed in a timely and effective manner (2.41). ICH
  4. 4EudraLex Volume 4, Chapter 5, Production (2014), section 5.29: audits of the manufacturers and distributors of active substances, with a report that fully reflects what was done and seen and clearly identifies deficiencies, required corrective and preventive actions implemented, and further audits at intervals defined by quality risk management. European Commission
  5. 5ICH Q10, Pharmaceutical Quality System (2008): section 3.2.2 (CAPA resulting from audits, regulatory inspections and findings, with the effectiveness of actions evaluated in commercial manufacturing), section 3.2.4 (management review including the results of inspections and audits and commitments made to regulatory authorities) and section 4.1 (review of the quality system, including audits and customer audits). ICH
  6. 6FDA, Compliance Policy Guide Sec. 130.300, FDA Access to Results of Quality Assurance Program Audits and Inspections (2007): during routine inspections FDA does not review or copy the reports and records of quality assurance programme audits, and may seek written certification that they were implemented, performed and documented and that required corrective action was taken. FDA
  7. 7EudraLex Volume 4, Chapter 1, Pharmaceutical Quality System (2013), sections 1.4 (xvii) (a process for self-inspection and/or quality audit that regularly appraises the effectiveness and applicability of the quality system) and 1.6 (periodic management review with the involvement of senior management). European Commission

AConnected records

Entity
What it records
Kind
Audit Universe
Sites, processes, systems, products, suppliers, risks, history, ownership and current state.
type
Audit Programme
Period, universe, risk method, required audits, frequencies, resources, exceptions and approval.
type
Annual Risk-Based Audit Programme
Internal, supplier and system audits prioritised by risk, change, performance, history and oversight.
template
AUDIT-PROGRAM v04
Approved programme revised after a supplier-quality signal.
instance
Audit or Inspection
Type, objective, scope, criteria, dates, team, auditee, logistics, status, report and closure.
type
GxP Process Audit
Scope, criteria, team, preparation, agenda, evidence, execution, findings, report and closure.
template
AUDIT-QC-LAB04
Completed laboratory audit with one major and two minor findings.
instance
Auditor Assignment
Auditor, role, competence, qualification, independence, conflicts, restrictions and approval.
type
Audit Agenda
Day, time, process, interviewee, auditor, criteria, questions, walkthrough, samples and status.
type
Audit Evidence Request
Wording, clarification, owner, priority, due time, evidence, review, delivery, follow-up and state.
type
Regulatory Inspection Request
Inspector wording, clarification, owner, scope, evidence package, review, delivery and follow-up.
template
REQ-INSP-042
Closed request after an approved replacement evidence package.
instance
Audit Evidence Item
Source record, version, scope, selection, rendition, checksum, redaction, review, delivery and state.
type
Audit Interview or Walkthrough
Participants, process, questions, responses, demonstrated evidence, observations, follow-ups and review.
type
Audit Sample
Population, selection method, strata, selected records, replacements, exceptions, results and conclusion.
type
Audit Observation
Condition, location, people, evidence, criterion, clarification, impact and potential finding.
type
Audit Finding
Statement, requirement, evidence, scope, severity, recurrence, risk, owner, response and final state.
type
GxP Audit Finding
Requirement, objective evidence, scope, severity, systemic assessment, response and acceptance.
template
FIND-022
Major repeat finding for ineffective periodic access review.
instance
Audit Response
Factual response, correction, impact, root cause, actions, commitments, evidence, approval and acceptance.
type
Audit Commitment
Source, promise, owner, due date, actions, evidence, submission, acceptance, escalation and closure.
type
Inspection Response Commitment
Promised outcome, actions, owner, date, evidence, submission, authority response and closure.
template
COMMIT-INSP-008
Open commitment after a failed first effectiveness review.
instance
Audit Effectiveness Review
Failure mode, metric, period, population, method, criteria, evidence, result, decision and closure.
type
Finding Effectiveness Verification
Failure mode, population, period, measures, sample, acceptance, evidence, review and outcome.
template
EV-FIND-022 v02
Second verification scheduled after recurrence in one department.
instance

BQuestions and answers

How is Seal different from the audit module in our eQMS?

A traditional eQMS schedules the audit, files the report and tracks findings as tasks, while the evidence is exported into a binder and checked by hand. In Seal a package references the source records at the versions selected, a missing source is an open request with an owner, and a finding links its assessment, change and verification. You can start with one audit beside the eQMS you already run.

Can internal, supplier and regulatory audits use different workflows?

Yes. Configure each engagement’s scope, criteria, roles, evidence requests and review requirements while keeping related source records connected.

Does selecting a source keep its version?

An evidence reference can pin a specific version. In the example, the package retains an earlier source revision even after that source changes. Replacing selected evidence needs its own review and history.

What happens when requested evidence is missing?

Keep the request open with an owner and follow-up. Record why the source is unavailable, or assess an authorised scope change. Missing evidence should not be counted as supplied or reviewed.

What can Neil prepare?

Using supplied documents and permitted records, Neil can assemble candidate evidence, investigate recurring findings and author request templates, fields and review workflows. People review disclosure, verify configuration and approve changes. In line with the EU’s draft GMP Annex 22 on AI, Neil is not used in GMP execution. It helps set up configuration, which your team verifies and releases under change control. See how Neil fits Annex 22.

Does Published mean approved for the audit?

No. In these captures, Published identifies a saved record version. Technical review, disclosure approval, delivery and audit acceptance are separate decisions.

How does a finding connect to CAPA?

Link the accepted finding and response to the investigation, corrective actions and required verification. Preserve the source evidence and decision rationale. An observation alone does not establish a root cause.

What should an effectiveness review contain?

Define the population, selection rule, review period and acceptance criteria for the specific action. Retain the results, source records, exceptions and authorised decision rather than closing solely because tasks are complete.

Will an FDA investigator ask for our internal audit reports?

In a routine inspection, FDA’s policy (Compliance Policy Guide Sec. 130.300) is not to review or copy the reports of quality assurance programme audits, except in the cases the guide lists, such as litigation or an inspection warrant. It may seek written certification that the audits were implemented, performed and documented and that required corrective action was taken, so keep the programme, the findings and their verified follow-up where they can be shown.

Where should we start?

Start with one real audit request and a small, defined evidence population. Prove selected versions, a missing source, a reviewed replacement and the required access and approval steps before expanding the workflow.

Capabilities

See your process in Seal.

Bring a procedure or a recurring problem. See how your team can use Neil to configure the workflow, investigate the results and improve the next version.

Book a demo