A safety signal may first appear as an explicit adverse-event form. It may also be buried in a patient-support call, a physician email, a literature article, a product complaint, a social message, or a field-team note. The words may be incomplete, multilingual, misspelled, or medically ambiguous.
The goal of AI is not to decide causality from a phone call. It is to improve capture, structure the evidence, identify cases that may be reportable, and give trained reviewers a complete, auditable starting point.
Why this is a model-stack problem
One end-to-end language model cannot reliably perform every stage. A defensible workflow separates:
- Channel capture and consent.
- Domain speech recognition or document parsing.
- Adverse-event and product-complaint detection.
- Entity and timeline extraction.
- Duplicate and follow-up matching.
- Triage and workflow routing.
- Narrative assistance.
- Human medical and regulatory review.
- Submission, reconciliation, and monitoring.
The FDA's Emerging Drug Safety Technology Program specifically addresses AI in pharmacovigilance, including human review of adverse-event reports and signal detection and evaluation. The technology can widen the intake funnel, but performance must be measured at the safety outcome, not only at transcript quality.
An early operating example
Pfizer reported that its Worldwide Safety organization processed approximately 1.4 million adverse events in 2019 and expected industry case volume to rise 20% annually. It developed an AI platform for repetitive intake and case-processing work, with its Rome Drug Safety Unit as the first live location. The first phase could make basic intake decisions such as whether a report was valid and whether it described a fatal or life-threatening event.
Pfizer safety leader Bhavin Patel described the intended labor model as "freeing up our experts" for more valuable human work. This is an older company account without published accuracy or cycle-time results. It is useful evidence of workflow design, not a current performance benchmark.
Stage 1: Capture the original evidence
Medical ASR should recognize brand and generic names, dosage units, routes, symptoms, diagnoses, dates, and negation. It must handle accents, poor telephone audio, and code-switching. Preserve the audio and time alignment so a reviewer can inspect the exact passage.
Evaluate word error rate, but do not stop there. More important measures are product-name accuracy, event-term accuracy, dose and unit accuracy, negation accuracy, and recall of statements that trigger safety review.
For email and scanned forms, preserve layout, handwriting confidence, attachments, and the original image. Do not silently normalize uncertain numbers.
Stage 2: Detect a possible case with high recall
A narrow classifier can flag whether content includes the minimum elements of an identifiable patient, identifiable reporter, suspect product, and adverse event. It should also detect pregnancy exposure, medication error, overdose, misuse, lack of efficacy, off-label use, quality complaint, and special situations defined by company procedure.
The threshold should reflect asymmetric risk. A false positive creates review work. A false negative can delay a reportable case. Track sensitivity by channel, language, product, and event type, not just aggregate F1.
Stage 3: Build a structured case timeline
An extraction model can populate:
- Patient descriptors without inventing identity.
- Reporter identity and contact permissions.
- Suspect and concomitant products.
- Dose, route, indication, therapy dates, and lot.
- Event, onset, seriousness criteria, outcome, and treatment.
- Relevant history, tests, and follow-up gaps.
- Source sentence and confidence for each field.
Temporal reasoning should be explicit. If "three days later" cannot be anchored to a known date, the output should retain a relative interval. A reviewer must be able to trace every populated field to original evidence.
Stage 4: Link duplicates and request follow-up
Duplicate detection requires more than name matching. It may combine partially masked demographics, product, event, dates, reporter, geography, narrative similarity, and source lineage. The output should be a ranked candidate list with reasons, not an automatic merge.
A workflow agent can identify missing fields and prepare a follow-up message from an approved template. It should not make new medical claims or expose information from a possible duplicate to the reporter.
Stage 5: Draft, code, and route without hiding uncertainty
Models can propose a case narrative, MedDRA candidates, product coding, seriousness, expectedness inputs, and case priority. Each proposal remains reviewable. The final clinical assessment, causality, listedness, and reportability decision stay with authorized professionals under company procedure.
Small models are useful for predictable classifications and structured fields. Retrieval can surface the current reference safety information, label, product data, and operating procedure. A larger model may draft the narrative, but it should receive only the verified facts.
Medical information uses the same foundation differently
When a clinician or patient asks a product question, the system can transcribe the request, classify intent, retrieve approved response content and labeling, draft an answer, and route it for review. At the same time, the safety classifier should inspect the interaction for a possible adverse event or product complaint.
This creates a shared intake layer with separate governed outputs:
- Medical-information response.
- Safety case.
- Product-quality complaint.
- Privacy request.
- Escalation for emergency or off-label discussion.
Retrieval must filter by product, indication, market, audience, and effective date. The answer should cite the controlling approved source and refuse unsupported personalization.
Production metrics
Model System Components
Domain ASR
critical entity accuracy.
Case detector
sensitivity by channel and event type.
Entity extraction
exact match and source traceability.
Duplicate matching
recall at review depth.
Narrative assist
factual consistency and edit distance.
Medical RAG
retrieval recall and citation precision.
| Component | Quality metric | Operating metric |
|---|---|---|
| Domain ASR | critical entity accuracy | manual correction minutes |
| Case detector | sensitivity by channel and event type | cases found, review volume |
| Entity extraction | exact match and source traceability | data-entry time, rework |
| Duplicate matching | recall at review depth | duplicate processing avoided |
| Narrative assist | factual consistency and edit distance | narrative preparation time |
| Medical RAG | retrieval recall and citation precision | first-response time |
| Workflow routing | correct queue and deadline | late-case rate |
Monitor subgroup and product drift. A model trained on contact-center speech may fail on field notes. A new product can introduce vocabulary and reporting patterns that invalidate an old threshold.
Governance gates
Keep an immutable record of original content, transcript or parse, extracted facts, retrieved sources, model versions, reviewer changes, and final action. Limit model access by product and geography. Mask personal data where possible and define retention separately for audio, transcript, and case record.
Red-team the system with negation, hypothetical questions, family members, multiple products, multilingual speech, homophones, vague dates, and non-events such as "I am worried this could happen." Also test urgent medical situations. The agent should route an emergency according to approved policy, not improvise treatment.
A practical pilot
Start with one intake channel and a retrospective set that includes both positives and hard negatives. Double-review the reference labels. Run the model in shadow mode and establish a lower confidence band that always goes to humans.
The first business case should combine safety and labor metrics: detection recall, serious-case recall, correction time, case-processing time, follow-up completeness, late submissions, and cost per quality-controlled case. A faster workflow is not a success if recall declines.
The conclusion
Safety AI should listen widely and act narrowly. Speech, extraction, retrieval, and matching models can turn fragmented evidence into a better case packet. Human reviewers retain the medical and regulatory judgment.
The result is not an autonomous pharmacovigilance system. It is a higher-recall, faster, and more auditable safety operation.
Research note
Research is current through September 5, 2026. Regulatory obligations differ by product, report type, and jurisdiction. The workflow described here requires validation against applicable pharmacovigilance, privacy, quality, and record-retention requirements.
Continue the research
- The complete pharma and life-sciences AI model stack
- Regulatory RAG for pharma submissions
- A 90-day path from AI pilot to production
- The hidden economics of enterprise AI
- Medical speech recognition and clinical ASR
Building a Production-Ready System
Conscious Engines builds pharmacovigilance AI that captures original evidence, detects possible cases with high recall, extracts a traceable timeline, ranks duplicates, and prepares reviewable narratives. Human safety professionals retain causality, listedness, reportability, and signal judgment.