Personalized Auto-Research: Towards a True AI Co-Scientist
A proposal that AI co-scientists can't be true collaborators unless they know who asked the question
Today's AI co-scientist systems generate hypotheses, design experiments, and draft papers, but they ignore who is actually asking, so a first-year PhD student and a senior professor typing the same goal get essentially the same output. This paper proposes 'personalized auto-research,' a framework that threads a graph-based representation of the individual researcher through every stage of the research pipeline, from literature retrieval to hypothesis search, experimentation, writing, and review. It is a conceptual paper with an algorithm and evaluation blueprint, not an implemented system with measured results.
METAL MEDIA explanatory visual
Structure of the personalized auto-research pipeline
Evidence statusProposal only · no measured results yet
- Graph-grounded researcher representationEncodes a researcher u's position in a graph of co-authorship, citation, affiliation, and method relations into a vector z_u
- Personalized context and evidence retrievalCombines the goal g with the researcher's context c_u to retrieve literature useful specifically to that researcher
- Personalized hypothesis searchA researcher-conditioned tree search expands hypotheses and scores them jointly on novelty, relevance, and feasibility for that individual
- Personalized package synthesisRuns code, writes, cites, and reviews the top hypotheses under the same researcher context, producing a reproducible research package
- Individual-grounded evaluationHolds out a past paper, rebuilds context from earlier records, and checks fidelity to the researcher's actual path and contrast across different contexts
What they did
- The paper argues existing AI co-scientist systems have advanced only along the 'autonomy' axis (how much they can do without a human) while remaining 'researcher-agnostic,' producing near-identical outputs regardless of who requests them.
- It proposes representing each researcher as a vector derived from their position in a graph of researchers, papers, institutions, and methods (a graph-grounded researcher representation), and conditioning every pipeline stage, retrieval, hypothesis search, experiment execution, writing, citation, and review, on this representation via a proposed algorithm (Algorithm 1).
- In hypothesis search, instead of filtering ideas by a binary novelty test, the framework ranks hypotheses by a personalized score combining novelty, relevance, and feasibility specific to that researcher.
- For evaluation, it proposes holding out a researcher's actual paper at some past time, rebuilding their context from only earlier records, and checking whether the system reproduces a similar hypothesis and experimental path (fidelity), and whether different researcher contexts actually diverge on the same goal (contrast).
- It extends the idea to teams of researchers and discusses open problems such as 'creativity collapse,' where many researchers querying the same generic system converge on the same ideas.
| Researcher-agnostic | Personalized | |
|---|---|---|
| Fully autonomous | AI Scientist (12; 33), DeepScientist (31), … | Personalized Auto-Research (Alg. 1) |
| Human-in-the-loop | Co-Scientist (4; 5), AutoResearchClaw (11), … | True AI Co-Scientist (Alg. 1 w/ human-in-the-loop) |
Findings
- No measured results have been reported yet.
Where it can be used
- Designing AI research-assistant tools that tailor literature search and experiment suggestions to a requester's prior work, collaborators, available resources, and methodological style, not just the stated goal
- Auditing whether an organization's shared AI research tool produces homogeneous outputs across different researchers and adjusting for that
- Building team-oriented research assistants that route experiments to the member best positioned to execute them based on individual feasibility and expertise
Limits and open work
- The entire contribution is conceptual and algorithmic; no implemented system or quantitative experimental results are presented.
- Even the proposed held-out evaluation protocol only checks whether the system responds differently to different researcher contexts; the authors acknowledge it cannot certify that a recommended direction is actually better.
- Extending to teams, handling cold-start for early-career researchers, and reconciling conflicting preferences within a team are left as open problems without solutions.
- Building the researcher graph requires collaborator, affiliation, and activity data, raising privacy and consent issues the paper flags as future work rather than resolving.
Why it matters
If many researchers rely on the same generic AI research tool, the diversity of explored ideas can collapse toward a monoculture, erasing directions that only a specific researcher's background could have surfaced. For anyone building or using AI research assistants, this is a reminder that a stronger general-purpose model alone does not solve the problem, and that incorporating user-specific context may matter as much as raw capability.
Terms in this paper
- AI co-scientist · A language-model agent system that generates hypotheses, retrieves literature, designs and runs experiments, and drafts manuscripts
- researcher-agnostic · A system property where outputs stay essentially the same regardless of who is requesting them
- graph-grounded researcher representation · A vector encoding a researcher's position in a graph of co-authorship, citations, affiliations, and methods
- structural hole · A gap between two unconnected regions of a research landscape, where bridging research is considered especially valuable
- creativity collapse · The phenomenon where many researchers querying the same generic system converge on the same narrow set of ideas
Original abstract (English)
AI co-scientists that generate hypotheses, retrieve related work, design experiments, execute code, and draft full papers are beginning to change how research is carried out. Despite this rapid progress, state-of-the-art systems remain researcher-agnostic: given a research goal, they optimize novelty, validity, or reviewer score while ignoring the individual scientist who will use the output. This overlooks a fundamental fact about research, namely, that what counts as novel, valuable, or feasible depends on the researcher, including their prior work, methodological repertoire, and the collaborators and communities in which they are embedded. In this work, we introduce the problem of personalized auto-research, which conditions every stage of the research process on a representation of the individual researcher. We argue that personalization is not a convenience layer, but rather the fundamental property that allows an AI system to serve as a genuine co-scientist rather than a generic instrument. To address this problem, we propose a general and flexible framework that threads a graph-grounded researcher context through retrieval, hypothesis search, experimentation, writing, and review. The framework consists of three fundamental components: (i) graph-grounded researcher representations, (ii) personalization across the full research pipeline, and (iii) evaluation grounded in the individual. Notably, we highlight a one-size-fits-all failure mode where distinct researchers issuing the same goal receive essentially the same research, erasing the tacit knowledge through which novel ideas arise. Finally, we discuss fundamental open problems and challenges.
Read on arXivLatest papers
- SWE-bench Science: Can Coding Agents Resolve Engineering Tasks in Science?AI coding agents were tested on fixing real scientific software, and even the best one failed more than half the time
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM ServingMaking sparse attention fast enough and accurate enough for real LLM serving, not just papers
- PolicyGuide: From Guarding One Action to Guiding the Whole Workflow for Policy-Compliant LLM AgentsMaking customer-service AI agents follow the whole procedure, not just avoid one bad action
- EXIMO: VLM Guided Exploration of VLA PoliciesTeaching a robot new chores without human teleoperation, by letting a chatty AI supervise it
- EnvHarness: Awakening Static Worlds for Agent LearningInstead of building new training worlds from scratch, this work adds a plug-in layer that reshapes existing ones around each agent's actual weaknesses
- Bounded Sovereignty and the Control Tax: Pricing AI Oversight When the Deployer Does Not Own the ModelCompanies that rent AI instead of owning it can only do half of AI safety oversight
- Beyond Imitation: Filtering On-Policy Distillation by Reasoning ProgressA fix for AI models that get penalized by their teacher even when they're reasoning correctly
- PersonalBench: Measuring the Authorship Gap in LLM PersonalizationAI can be prompted to write 'like someone,' but its own voice never fully disappears