Research Assistant: AstraZeneca's Agentic System for R&D

What they did

1. The system runs 12 specialized 'Tool Agents' covering literature search, biological knowledge graphs, compound chemistry, clinical trials, drug safety, gene expression and internal experimental data; relevant agents are triggered in parallel and a larger LLM synthesizes the final answer from their outputs.
2. Instead of running all agents for every query, a 'Tool Agent Picker' router detects topics in the user's question and selects only the matching agents; the team first tried embedding-based nearest-neighbor matching to example queries but found it hard to maintain, so they switched to automated topic modeling over tens of thousands of real user interactions mapped to agent sets.
3. For complex questions, Deep Research Mode automatically builds a research plan modeled as a directed acyclic graph (DAG) of sub-questions, executes them in topological order, and rewrites later questions using information found in earlier steps (e.g., substituting a drug synonym discovered earlier).
4. Early in development, with no users yet, the team used a 100-question subset of BioASQ yes/no questions to compare balanced accuracy against 'vanilla' LLMs like GPT-4, and used the STaRK benchmark (based on PrimeKG, mapped to AstraZeneca's internal knowledge graph BIKG) to check overlap between retrieved graph triples and expected results; later they used an LLM judge agent to score real user question-response pairs.
5. An example of programmatic use is the CRAM Auto Tool, which calls Research Assistant via its REST/MCP API to support Combination Risk Assessment for drug safety scientists evaluating risks when multiple drugs are used together.

Findings

• Early in development, a 100-question BioASQ yes/no subset was used as a sanity check to compare balanced accuracy against 'vanilla' LLMs such as GPT-4.
• The STaRK benchmark (PrimeKG queries mapped to AstraZeneca's internal BIKG) was used to compute overlap statistics between triples returned by the Knowledge Graph Tool Agent and expected node sets, monitoring for regressions.
• The system grew from a small pilot to 15,000 unique internal users within one year and now supports thousands of monthly interactions.
• Based on July 2026 Google Cloud Platform token pricing, the average cost per Research Assistant query is about 16 cents (covering all input/output tokens using Gemini 3 Flash and Gemini 3.1 Pro), with typical response times of 10 to 30 seconds.
• Improvements made based on user feedback did not translate into higher scores on the BioASQ question set, revealing a mismatch between biomedical QA benchmarks and real user needs.

Where it can be used

• Designing an internal enterprise research chatbot that unifies literature, knowledge graph, chemistry and clinical trial search with cited, traceable answers
• Building programmatic integrations, similar to the CRAM Auto Tool, where other internal safety or research tools call the assistant via REST/MCP APIs for tasks like combination drug risk assessment
• Structuring complex multi-step research questions as a DAG-based execution plan that reuses earlier findings (like synonyms) in later steps
• Designing a topic-based routing layer that selectively activates only relevant tools per query to control latency and cost

Limits and open work

• The authors report ongoing challenges with hallucinations and limited sensitivity to fine biological nuance, such as distinguishing closely related gene paralogs.
• Benchmarks like BioASQ and STaRK served mainly as early-stage sanity checks and regression monitors, not as comprehensive measures of real-world usefulness, and improvements didn't necessarily show up there.
• The Web Search Agent can surface content from non-credible sources like forums and blogs, and Gemini's grounding claims sometimes overstate how closely a cited web source actually supports a fact, requiring extra verification.
• The system is tightly integrated with AstraZeneca's proprietary infrastructure (BIKG, CAG, internal ELN systems), making direct replication elsewhere difficult.
• As a technical note rather than a formal research paper, it does not provide systematic head-to-head accuracy comparisons against other production systems.

Why it matters

This gives teams building similar enterprise R&D assistants a concrete, deployed reference architecture for grounding LLM answers in multiple structured and unstructured data sources at scale, including a working topic-based tool-routing approach. It also flags a practical lesson: improvements driven by real user feedback did not track with gains on standard biomedical QA benchmarks, underscoring the gap between benchmark scores and real-world usefulness.

Terms in this paper

• Grounding · Anchoring an LLM's answer in retrieved evidence so statements can be traced back to real sources, reducing hallucination
• Knowledge Graph · A database representing entities like genes, diseases and drugs as nodes connected by relationship edges
• DAG (directed acyclic graph) · A graph of steps with directional dependencies and no loops, used here to order sub-questions in a research plan
• GraphRAG · A method that retrieves facts from a knowledge graph to ground an LLM's answer and reduce hallucinations
• MCP (Model Context Protocol) · A standardized interface that lets other AI systems call this tool programmatically

Latest papers

• SWE-bench Science: Can Coding Agents Resolve Engineering Tasks in Science?AI coding agents were tested on fixing real scientific software, and even the best one failed more than half the timearXiv:2608.197992026-08-21
• FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM ServingMaking sparse attention fast enough and accurate enough for real LLM serving, not just papersarXiv:2608.197582026-08-21
• PolicyGuide: From Guarding One Action to Guiding the Whole Workflow for Policy-Compliant LLM AgentsMaking customer-service AI agents follow the whole procedure, not just avoid one bad actionarXiv:2608.198612026-08-21
• EXIMO: VLM Guided Exploration of VLA PoliciesTeaching a robot new chores without human teleoperation, by letting a chatty AI supervise itarXiv:2608.198912026-08-21
• EnvHarness: Awakening Static Worlds for Agent LearningInstead of building new training worlds from scratch, this work adds a plug-in layer that reshapes existing ones around each agent's actual weaknessesarXiv:2608.198802026-08-21
• Bounded Sovereignty and the Control Tax: Pricing AI Oversight When the Deployer Does Not Own the ModelCompanies that rent AI instead of owning it can only do half of AI safety oversightarXiv:2608.192162026-08-21
• Beyond Imitation: Filtering On-Policy Distillation by Reasoning ProgressA fix for AI models that get penalized by their teacher even when they're reasoning correctlyarXiv:2608.194082026-08-21
• PersonalBench: Measuring the Authorship Gap in LLM PersonalizationAI can be prompted to write 'like someone,' but its own voice never fully disappearsarXiv:2608.197462026-08-21

Latest from METAL MEDIA

• TUIDE debut with 'SUN KISS,' an Iceland-shot K-pop road movie
• NCT 127 drop BLINGY, their first full album in two years