Research Assistant: AstraZeneca's Agentic System for R&D
How AstraZeneca built an internal biomedical AI chatbot now used by over 15,000 employees
AstraZeneca researchers built Research Assistant, a chat-based system that pulls evidence from literature, knowledge graphs, chemistry, clinical trials and safety databases to answer biomedical questions with cited sources. It offers a fast single-pass Scientific Mode and a multi-step Deep Research Mode that plans and executes a chain of sub-questions, and grew from a small pilot to 15,000 unique internal users within a year. This is a technical note describing the system's architecture, design choices and lessons from deploying it at scale, rather than a traditional research paper with head-to-head benchmark results.
METAL MEDIA explanatory visual
How Research Assistant Processes a Query
Evidence statusMeasured results and planned work
- User questionA biomedical question typed into the chat interface is routed to either single-pass Scientific Mode or multi-step Deep Research Mode.
- Tool Agent PickerDetects topics in the query (chemistry, biological relationships, drug safety, etc.) and selects only the matching subset of 12 specialized agents to run in parallel.
- Evidence collection (Observation)Each selected agent returns evidence as a standardized Observation object containing an ID, source URL, grounding data and citation text.
- LLM synthesis with citationsA larger LLM composes the final answer strictly from the retrieved evidence and links each statement back to its source for user verification.
- Real-user feedback loopTens of thousands of logged user interactions plus an LLM judge agent scoring answers are used to identify which data sources or agents need improvement.
What they did
- The system runs 12 specialized 'Tool Agents' covering literature search, biological knowledge graphs, compound chemistry, clinical trials, drug safety, gene expression and internal experimental data; relevant agents are triggered in parallel and a larger LLM synthesizes the final answer from their outputs.
- Instead of running all agents for every query, a 'Tool Agent Picker' router detects topics in the user's question and selects only the matching agents; the team first tried embedding-based nearest-neighbor matching to example queries but found it hard to maintain, so they switched to automated topic modeling over tens of thousands of real user interactions mapped to agent sets.
- For complex questions, Deep Research Mode automatically builds a research plan modeled as a directed acyclic graph (DAG) of sub-questions, executes them in topological order, and rewrites later questions using information found in earlier steps (e.g., substituting a drug synonym discovered earlier).
- Early in development, with no users yet, the team used a 100-question subset of BioASQ yes/no questions to compare balanced accuracy against 'vanilla' LLMs like GPT-4, and used the STaRK benchmark (based on PrimeKG, mapped to AstraZeneca's internal knowledge graph BIKG) to check overlap between retrieved graph triples and expected results; later they used an LLM judge agent to score real user question-response pairs.
- An example of programmatic use is the CRAM Auto Tool, which calls Research Assistant via its REST/MCP API to support Combination Risk Assessment for drug safety scientists evaluating risks when multiple drugs are used together.
| Agent Name | Use-Case | Topics |
|---|---|---|
| Literature Agent | Scientific literature search, electronic notebooks, patent/conference lookups. | biological relationships, chemistry information, drug safety, general biomedical knowledge, internal experimental data |
| Compound Agent | Compound ID lookups, SMILES resolution, bioactivity, physicochemical properties. | chemistry information, entity synonyms |
| Knowledge Graph Agent | Pairwise entity relationships (gene–disease, compound–target, compound–disease). | biological relationships |
| Clinical Trial Agent | Trial search by drug/condition/status/sponsor; specific NCT lookups, inclusion/exclusion criteria. | clinical endpoints, clinical trials |
| Web Search Agent | Real-time web search; recent organised events and news. | general biomedical knowledge, recent events |
| OFF-X Agent | Drug adverse events and safety alerts by drug name or gene target. | drug safety |
| Discover Agent | Ranked predictions of novel gene–disease–compound associations. | discovery and ranking |
| Mapping Agent | Cross-database ID and synonym mapping for compounds, genes, diseases. | entity synonyms |
| Clinical Endpoints Agent | Clinical efficacy endpoint extraction (OS, PFS, ORR, CR) with LLM-generated summary. | clinical endpoints |
| Human Protein Atlas Agent | Tissue and cell-type gene expression levels (broad patterns or specific TPM/CPM values). | gene expression |
| Glossary Agent | AstraZeneca-specific acronym and abbreviation definitions. | AZ terminology |
| In Vivo Agent | Internal AZ in vivo study data: toxicity studies, animal models, compound testing, dosing. | internal experimental data, preclinical studies |
Findings
- Early in development, a 100-question BioASQ yes/no subset was used as a sanity check to compare balanced accuracy against 'vanilla' LLMs such as GPT-4.
- The STaRK benchmark (PrimeKG queries mapped to AstraZeneca's internal BIKG) was used to compute overlap statistics between triples returned by the Knowledge Graph Tool Agent and expected node sets, monitoring for regressions.
- The system grew from a small pilot to 15,000 unique internal users within one year and now supports thousands of monthly interactions.
- Based on July 2026 Google Cloud Platform token pricing, the average cost per Research Assistant query is about 16 cents (covering all input/output tokens using Gemini 3 Flash and Gemini 3.1 Pro), with typical response times of 10 to 30 seconds.
- Improvements made based on user feedback did not translate into higher scores on the BioASQ question set, revealing a mismatch between biomedical QA benchmarks and real user needs.
Where it can be used
- Designing an internal enterprise research chatbot that unifies literature, knowledge graph, chemistry and clinical trial search with cited, traceable answers
- Building programmatic integrations, similar to the CRAM Auto Tool, where other internal safety or research tools call the assistant via REST/MCP APIs for tasks like combination drug risk assessment
- Structuring complex multi-step research questions as a DAG-based execution plan that reuses earlier findings (like synonyms) in later steps
- Designing a topic-based routing layer that selectively activates only relevant tools per query to control latency and cost
Limits and open work
- The authors report ongoing challenges with hallucinations and limited sensitivity to fine biological nuance, such as distinguishing closely related gene paralogs.
- Benchmarks like BioASQ and STaRK served mainly as early-stage sanity checks and regression monitors, not as comprehensive measures of real-world usefulness, and improvements didn't necessarily show up there.
- The Web Search Agent can surface content from non-credible sources like forums and blogs, and Gemini's grounding claims sometimes overstate how closely a cited web source actually supports a fact, requiring extra verification.
- The system is tightly integrated with AstraZeneca's proprietary infrastructure (BIKG, CAG, internal ELN systems), making direct replication elsewhere difficult.
- As a technical note rather than a formal research paper, it does not provide systematic head-to-head accuracy comparisons against other production systems.
Why it matters
This gives teams building similar enterprise R&D assistants a concrete, deployed reference architecture for grounding LLM answers in multiple structured and unstructured data sources at scale, including a working topic-based tool-routing approach. It also flags a practical lesson: improvements driven by real user feedback did not track with gains on standard biomedical QA benchmarks, underscoring the gap between benchmark scores and real-world usefulness.
Terms in this paper
- Grounding · Anchoring an LLM's answer in retrieved evidence so statements can be traced back to real sources, reducing hallucination
- Knowledge Graph · A database representing entities like genes, diseases and drugs as nodes connected by relationship edges
- DAG (directed acyclic graph) · A graph of steps with directional dependencies and no loops, used here to order sub-questions in a research plan
- GraphRAG · A method that retrieves facts from a knowledge graph to ground an LLM's answer and reduce hallucinations
- MCP (Model Context Protocol) · A standardized interface that lets other AI systems call this tool programmatically
Original abstract (English)
We describe Research Assistant, an internal LLM-based system developed at AstraZeneca to help scientists and clinicians explore biomedical questions across a broad range of data sources. The system provides a chat-style interface that brings together evidence from scientific literature, knowledge graphs, chemistry, clinical trials, safety resources, expression data, and internal experimental systems. It supports both a fast mode for direct question answering and a multi-step mode for more complex research tasks. Responses are grounded in retrieved evidence and linked back to the original sources, allowing users to review and further explore the underlying data. In this technical note, we outline the system architecture, the main design choices behind the product, and lessons learned from deploying it at scale to support day-to-day R&D workflows across AstraZeneca.
Read on arXivLatest papers
- SWE-bench Science: Can Coding Agents Resolve Engineering Tasks in Science?AI coding agents were tested on fixing real scientific software, and even the best one failed more than half the time
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM ServingMaking sparse attention fast enough and accurate enough for real LLM serving, not just papers
- PolicyGuide: From Guarding One Action to Guiding the Whole Workflow for Policy-Compliant LLM AgentsMaking customer-service AI agents follow the whole procedure, not just avoid one bad action
- EXIMO: VLM Guided Exploration of VLA PoliciesTeaching a robot new chores without human teleoperation, by letting a chatty AI supervise it
- EnvHarness: Awakening Static Worlds for Agent LearningInstead of building new training worlds from scratch, this work adds a plug-in layer that reshapes existing ones around each agent's actual weaknesses
- Bounded Sovereignty and the Control Tax: Pricing AI Oversight When the Deployer Does Not Own the ModelCompanies that rent AI instead of owning it can only do half of AI safety oversight
- PersonalBench: Measuring the Authorship Gap in LLM PersonalizationAI can be prompted to write 'like someone,' but its own voice never fully disappears
- Automated Summarization of Financial News Using Large Language Models and Retrieval-Augmented Generation: An Early Empirical Study (Fall 2023)Testing AI summaries of stock news, the simple approach beat the trendy retrieval-based one
Latest from METAL MEDIA
Figures: Piotr Grabowski et al., arXiv:2608.12395, cc-by-nc-nd-4.0