We’re putting $5.5M behind research and development of smaller, specialized AI models for real-world deployment — Read our manifesto →
    All posts

    From Protocol to Submission: Building the Regulatory Knowledge Layer

    A technical guide to evidence-grounded AI for clinical documents, authority questions, commitments, labeling, and submission operations.

    Conscious Engines

    Regulatory work is not ordinary document search. A single answer may depend on a protocol amendment, a statistical analysis plan, a clinical study report, a health-authority question, prior company correspondence, regional guidance, and an approved label. The source must be correct for the product, indication, market, and date.

    This makes regulatory intelligence a strong enterprise RAG and document-model use case. It also makes a generic chat interface unsafe. The system needs document control, structured retrieval, claim-level citations, workflow permissions, and a clear boundary between drafting and approval.

    The evidence burden is increasing

    The FDA says it has experience with more than 500 submissions containing AI components since 2016. AI is therefore both a tool used to prepare work and, increasingly, a subject that sponsors must explain.

    The FDA and EMA principles for AI in medicines development call for a defined context of use, multidisciplinary expertise, risk-based development, data governance, standards, clear information, and lifecycle management. Those principles provide a useful design test for internal regulatory copilots even when the model itself is not part of a product submission.

    The FDA is also testing AI internally. After an initial scientific-review pilot, Commissioner Marty Makary said, "I was blown away by the success". The statement is an early agency report, not a controlled productivity study, but it indicates that review workflows themselves are becoming an AI surface.

    The knowledge model must represent regulatory meaning

    Chunking PDFs into equal lengths loses the relationships that determine correctness. Build a document model with fields such as:

    • Product, active ingredient, formulation, strength, indication, and population.
    • Study, site, cohort, endpoint, analysis set, and data cutoff.
    • Market, authority, legal entity, submission type, and procedure.
    • Document type, version, status, effective date, superseded-by link, and owner.
    • Question, response, commitment, deadline, and completion evidence.
    • Table, figure, section, footnote, claim, and cited source.

    Tables and appendices require layout-aware parsing. Cross-references should resolve to their targets. Scanned correspondence needs OCR quality checks. A retrieved passage should retain its page, section, document version, and access policy.

    Seven high-value workflows

    Seven high-value workflows

    Protocol and amendment comparison

    Extract and compare objectives, endpoints, eligibility, assessments, visit schedules, stopping rules, and statistical changes.

    Submission content reuse

    Find previously approved descriptions, methods, analyses, and responses for an appropriate product and context.

    Health-authority question response

    Classify a question, decompose it into evidence needs, retrieve source material, draft a response outline, and track reviewers and due dates.

    Commitment management

    Extract postmarketing commitments, requested studies, milestones, reporting dates, and completion criteria from correspondence. Connect them to owners and operational systems.

    Label intelligence

    Compare labels across markets, versions, indications, and competitor products.

    Guidance surveillance

    Monitor agency publications, classify applicability, compare the new text with current procedure, and route an impact assessment. A human determines the regulatory interpretation.

    1. Protocol and amendment comparison

    Extract and compare objectives, endpoints, eligibility, assessments, visit schedules, stopping rules, and statistical changes. The output should identify the exact old and new text, not merely summarize the change.

    Measure field-level recall, false-change rate, reviewer time, and downstream inconsistency found in related documents.

    2. Submission content reuse

    Find previously approved descriptions, methods, analyses, and responses for an appropriate product and context. Retrieval must exclude obsolete, rejected, draft, or market-incompatible content.

    3. Health-authority question response

    Classify a question, decompose it into evidence needs, retrieve source material, draft a response outline, and track reviewers and due dates. Each substantive claim should map to a source. Missing evidence should be an explicit output.

    4. Commitment management

    Extract postmarketing commitments, requested studies, milestones, reporting dates, and completion criteria from correspondence. Connect them to owners and operational systems. Use deterministic date calculations and escalations.

    5. Label intelligence

    Compare labels across markets, versions, indications, and competitor products. A structured model should distinguish approved language from proposed language and show the evidence supporting a change.

    6. Guidance surveillance

    Monitor agency publications, classify applicability, compare the new text with current procedure, and route an impact assessment. A human determines the regulatory interpretation.

    7. Submission quality control

    Check terminology, identifiers, dates, cross-references, tables, abbreviations, and consistency among components. These narrow checks are good candidates for small models and rules because correctness is measurable.

    The architecture

    1. Controlled ingestion: accept only known repositories and preserve source identity.
    2. Document intelligence: classify files, parse layout, resolve sections and tables, and extract metadata.
    3. Regulatory graph: connect product, study, submission, question, response, commitment, and label.
    4. Hybrid retrieval: combine keyword, vector, metadata, graph, and authority filters.
    5. Task-specific SLM: classify intent, form search plans, compare evidence, and structure drafts.
    6. Citation service: bind each claim to an exact source span and version.
    7. Workflow control: enforce roles, approvals, deadlines, and write permissions.
    8. Evaluation and audit: retain prompts, retrieved evidence, model version, corrections, and final disposition.

    Why smaller models belong in the system

    Many regulatory tasks have a narrow vocabulary and output schema: document classification, study identifier extraction, commitment detection, question routing, or consistency checking. A tuned SLM can run privately, provide lower latency, and be tested against a fixed field-level dataset. A larger model can be reserved for ambiguous synthesis.

    Routing by task also reduces exposure. A model extracting dates from a controlled document does not need access to an entire dossier. Least-privilege retrieval should apply to models as well as people.

    Evaluation that mirrors review work

    TestPrimary metricFailure to inspect
    Document parsingsection and table reconstruction accuracymerged columns, lost footnotes
    Metadata extractionexact match by fieldwrong product, market, or version
    Retrievalrecall at a fixed review depthmissed controlling source
    Answer draftingclaim support rateuncited or overextended claim
    Comparisonchange precision and recallmaterial change hidden in summary
    Commitment extractionobligation and date recallmissed or misassigned commitment
    Access controlunauthorized retrieval ratecross-product or restricted evidence

    Test with adversarial cases: superseded guidance, draft labels, similar study codes, conflicting documents, scanned letters, missing appendices, and questions with no supported answer. A fluent refusal is better than an invented response.

    A credible 12-week pilot

    Select one product and one workflow, such as protocol comparison or authority-question research. Assemble 200 to 500 completed cases. Have regulatory experts label the controlling evidence, acceptable answer components, and high-severity errors.

    In weeks 1 to 4, establish parsing and retrieval baselines. In weeks 5 to 8, add structured drafting and citation validation. In weeks 9 to 12, run shadow cases and compare cycle time, evidence coverage, correction rate, and reviewer confidence with the current process.

    Do not use time saved as the only success criterion. A valid result must maintain or improve evidence completeness and reduce rework.

    The conclusion

    The regulatory knowledge layer should behave like a controlled evidence system, not a conversational search engine. Its job is to locate the right source, preserve context, expose gaps, and accelerate expert review.

    When protocol, submission, correspondence, commitment, and label data share a governed model, the organization can answer faster without weakening the chain of evidence.

    Research note

    Research is current through September 5, 2026. Regulatory principles are summarized from FDA and EMA sources. The proposed metrics and pilot gates are implementation recommendations, not agency requirements.

    Continue the research

    Building a Production-Ready System

    Conscious Engines builds pharma regulatory RAG as a controlled evidence system. It models product, study, market, submission, document version, question, response, and commitment so every generated claim can be traced to the correct source and reviewed before regulatory use.