K-文化的一切——从回归到 K-美妆，发送到您的邮箱订阅邮件

METAL MEDIA

Nine Emotion Centroids: A Label-Free Valence Axis That Transfers Across Four Modalities

arXiv:2608.180902026-08-20

只用9个情绪词和450段小故事,就能在AI内部找到判断正负情绪的方向,而且这个方向在文字、图像、声音甚至脑电波中都通用

语言模型内部藏着一条能判断一句话是正面还是负面情绪的内部方向,这篇论文展示了如何仅用9个情绪类别名称和每种情绪约50段短故事(而不是传统方法所需的数千条标注数据)就能找到这条方向。用同样的方法在从未一起训练过的图像、音频和人类脑电波模型中,也能找到几乎相同的方向。研究者从语言模型内部人为删除这条方向后,情绪判断能力大幅下降,证明这条方向不只是与情绪相关,而是真正在起作用。

METAL MEDIA 解读图

只用9个情绪词和450段小故事,就能在AI内部找到判断正负情绪的方向,而且这个方向在文字、图像、声音甚至脑电波中都通用

  1. 01仅用愤怒、喜悦、恐惧等9个情绪类别名称,以及每种情绪约50段(共450段)短篇叙事段落,比传统监督学习方法少用约1500倍的标注数据,就找到了这条'效价轴'(V-axis)。
  2. 02具体做法是:把这些故事输入一个冻结(不再训练)的编码器模型,按情绪类别取平均得到9个情绪中心向量,再用主成分分析找出这9个点分布最分散的方向,即为V-axis。
  3. 03这条V-axis在四种不同领域都能达到与监督学习分类器相差7个百分点以内的效果:文本(Llama-3-8B在SST-2情感分类上AUC为0.772,达到监督学习0.828的93%)、图像(EmoSet数据集上与人工评分相关系数为0.636)、音频(ESC-50上AUC为0.906)、脑电波(FACED数据集上AUC为0.720)。
  4. 04研究者从语言模型内部强行删除这条V-axis方向后,三个不同模型的情感分类准确率下降了5.5到37.2个百分点,而删除同等大小的随机方向最多只下降0.88个百分点,证明这条方向确实被模型用来做情感判断,而非仅仅是巧合相关。
  5. 05仅用文本数据训练的一个极简两参数分类器,不经任何额外训练就能直接用于图像(AUC 0.961)、音频(0.764)和脑电波(0.828)数据,效果远超使用16维通用共享特征的方法(0.525,接近随机水平)。
这是 METAL MEDIA 制作的解读图，并非论文作者提供的原图。

他们做了什么

  1. 仅用愤怒、喜悦、恐惧等9个情绪类别名称,以及每种情绪约50段(共450段)短篇叙事段落,比传统监督学习方法少用约1500倍的标注数据,就找到了这条'效价轴'(V-axis)。
  2. 具体做法是:把这些故事输入一个冻结(不再训练)的编码器模型,按情绪类别取平均得到9个情绪中心向量,再用主成分分析找出这9个点分布最分散的方向,即为V-axis。
  3. 这条V-axis在四种不同领域都能达到与监督学习分类器相差7个百分点以内的效果:文本(Llama-3-8B在SST-2情感分类上AUC为0.772,达到监督学习0.828的93%)、图像(EmoSet数据集上与人工评分相关系数为0.636)、音频(ESC-50上AUC为0.906)、脑电波(FACED数据集上AUC为0.720)。
  4. 研究者从语言模型内部强行删除这条V-axis方向后,三个不同模型的情感分类准确率下降了5.5到37.2个百分点,而删除同等大小的随机方向最多只下降0.88个百分点,证明这条方向确实被模型用来做情感判断,而非仅仅是巧合相关。
  5. 仅用文本数据训练的一个极简两参数分类器,不经任何额外训练就能直接用于图像(AUC 0.961)、音频(0.764)和脑电波(0.828)数据,效果远超使用16维通用共享特征的方法(0.525,接近随机水平)。
Figure 1: V-axis ablation degrades sentiment readout in three LLMs; matched-norm random-direction ablation does not. Bars: drop in SST-2 dev accuracy (pp) from inference-time projection out of the residual stream of the V-axis (dark) vs. K=3 matched-norm random directions (light, error bar = std). Annotation: drop in pp. z is |V-drop|/σrandom. Each panel uses the model’s sentiment-optimal block; Qwen3-8B uses block 23 (depth 0.86), consistent with the reasoning-distillation depth shift (§7).
Figure 1: V-axis ablation degrades sentiment readout in three LLMs; matched-norm random-direction ablation does not. Bars: drop in SST-2 dev accuracy (pp) from inference-time projection out of the residual stream of the V-axis (dark) vs. K=3 matched-norm random directions (light, error bar = std). Annotation: drop in pp. z is |V-drop|/σrandom. Each panel uses the model’s sentiment-optimal block; Qwen3-8B uses block 23 (depth 0.86), consistent with the reasoning-distillation depth shift (§7).
Table 1: V-axis (label-free for text/image/audio, supervised-in-axis for EEG) recovers supervised-classifier valence within 7 pp AUC across four modalities. Recipe AUC: held-out AUC of σ​(⟨x,v1⟩) where v1 is the V-axis (text Pearson r for vision). Sup. AUC: a logistic-regression head trained on the modality’s full label set (nSST-2=6,920; nEmoSet=11,811; nESC-50=2,000; nFACED=123 subjects). Ratio: recipe/supervised. See §3.
ModalityEncoderDatasetRecipe AUCSup. AUCRatiop
TextLlama-3-8B-Inst (block 20)SST-20.7720.82893%—
TextQwen3-8B (block 31, depth 0.86)SST-20.7870.84094%—
VisionCLIP-img-768EmoSetr=+0.636r=+0.8179%null 0.112
AudioCLAP-aud-512ESC-500.9060.9496%2.2×10−15
EEGCBraMod-200FACED0.720±0.0550.8387%3.65×10−8
Figure 2: All 12/12 cross-modal cells transfer at AUC ≥0.70. Rows: source modality on which the 2-parameter logistic head was fitted (binary valence labels). Columns: target modality evaluated. Diagonal: 5-fold self-CV (ntext=8,872; nimage=5,905; naudio=1,040; nEEG=1,725). Off-diagonal: cross-modal, nsource∈{728,1034,4133,8000}, no target labels at the head-fitting stage. See §5.
Figure 2: All 12/12 cross-modal cells transfer at AUC ≥0.70. Rows: source modality on which the 2-parameter logistic head was fitted (binary valence labels). Columns: target modality evaluated. Diagonal: 5-fold self-CV (ntext=8,872; nimage=5,905; naudio=1,040; nEEG=1,725). Off-diagonal: cross-modal, nsource∈{728,1034,4133,8000}, no target labels at the head-fitting stage. See §5.
Table 2: V-axis directional ablation drops SST-2 sentiment classification by 5.5–37.2 percentage points across three LLMs (≥12​σ above matched-norm null in every row). Columns: Base/V-abl.: SST-2 dev-split accuracy (%) without/with V-axis projection ablation. Drop (V): V-ablation accuracy − baseline accuracy (pp). Random: mean±std drop over K=3 matched-norm random-direction draws. z=|Drop(V)|/σRandom. nval=872. Source: experiments/d31_causal_mediation/results/. See §4.
ModelBlockBase (%)V-abl. (%)Drop (V)Random (μ±σ)z
Llama-3-8B-Inst2087.9682.45−5.50 pp−0.15±0.05 pp109
Qwen3-1.7B1884.4068.58−15.83 pp−0.88±1.24 pp12
Qwen3-8B2387.6150.46−37.16 pp−0.08±0.19 pp196
Figure 3: V-axis recipe (blue) matches supervised heads (grey) within 7 pp AUC across four modalities; null directions (red dashed) sit at chance. Bars: V-axis vs. supervised performance per modality. Vision: Pearson r to crowdworker valence (EmoSet). Other modalities: held-out AUC. Same numbers as Table 1 in the main paper.
Figure 3: V-axis recipe (blue) matches supervised heads (grey) within 7 pp AUC across four modalities; null directions (red dashed) sit at chance. Bars: V-axis vs. supervised performance per modality. Vision: Pearson r to crowdworker valence (EmoSet). Other modalities: held-out AUC. Same numbers as Table 1 in the main paper.
Table 3: 4×4 V-axis cross-modal AUC matrix; all 12/12 off-diagonal cells ≥0.70. Each entry: held-out AUC of a 2-parameter logistic regression trained on source modality V-axis projections (binary valence) and evaluated on target modality projections. Diagonal: 5-fold CV self-AUC. Off-diagonal: cross-modal transfer with no target-modality labels at the head-fitting stage; sign per modality is fixed once from the source positive class (no off-diagonal sign search). Random-direction baselines per off-diagonal cell are 0.52–0.59. See §5.
Source ↓ Target →TextImageAudioEEG
Text0.741 (CV)0.9610.7640.828
Image0.7250.960 (CV)0.7640.828
Audio0.7250.9610.751 (CV)0.828
EEG0.7250.9610.7640.867 (CV)
Table 4: One sentiment-specific dimension beats 16 generic dimensions by 0.18–0.44 AUC for cross-modal sentiment transfer. All entries: held-out AUC of an SST-2-trained classifier evaluated on EmoSet image valence (ntest=1,772). The bridge in each row replaces the V-axis with the listed substrate. See §5.
Bridge between text and image encoderCross-modal AUC
Generic K=16 substrate (same encoder family)0.525 (chance)
Random K=16 subspace≈ chance
Cross-encoder-family substrate (CLIP-text + CLAP-audio)≈ chance
Raw 768-D CLIP-text features0.771
V-axis (1-D, sentiment-specific)0.961

为什么重要

这项研究说明,像情绪这种模糊的人类感受,也能用极少量样本在AI内部被精确定位,并且这个方向能跨越文字、图像、声音甚至脑电波共享,这意味着未来构建情感识别系统可能会变得更便宜、更快捷。但研究也发现同样的方法能操控Llama和Mistral系列模型生成内容的情绪倾向,而对Qwen和Gemma系列无效,这提示该技术存在被滥用来操纵AI输出情绪的风险,值得警惕。

本文术语

  • 效价轴(V-axis) · AI模型内部表示空间中,标示事物正面或负面程度的一条单一方向
  • 残差流(residual stream) · Transformer模型逐层累加信息所形成的内部状态流
  • 主成分分析(PCA) · 一种统计方法,用于找出一组数据点分布最分散的方向
  • AUC · 衡量分类器区分正确与错误答案能力的指标,1.0为完美,0.5为随机猜测水平
  • 方向性消融(directional ablation) · 一种实验手段,强行从模型内部状态中去除某个特定方向的成分

论文原文摘要（英文）

Inside a modern language model sits a single internal direction that tracks how positive or negative a sentence feels. We show how to find this valence axis (V-axis) from just 9 emotion category names plus 50 short narrative paragraphs per emotion -- about 1,500 fewer labels than the usual supervised approach -- and that the same direction appears in vision, audio, and human-brain encoders never jointly trained. The recipe: embed nine emotion-anchored story sets in a frozen encoder, take the top principal direction of the nine averaged embeddings. Projecting new inputs onto it captures 93% of supervised performance on SST-2 (Llama-3-8B-Instruct, AUC 0.772 vs. 0.828), correlates with human valence ratings on 11,811 EmoSet images at r=0.636, reaches AUC 0.906 on ESC-50 audio (p 12). A 2-parameter classifier trained on text labels transfers to images (AUC 0.961), audio (0.764), and brain recordings (0.828) without target-modality labels; a generic 16-D subspace stays at chance (0.525). The recipe is bounded to continuous attributes -- seven tests on categorical concepts return near-chance -- and steering is family-specific (Llama/Mistral yes, Qwen/Gemma no).

作者 · Yousef Radwan

在 arXiv 阅读

最新论文

全部论文 →

METAL MEDIA 最新报道

图片来源： Yousef Radwan et al., arXiv:2608.18090, CC BY 4.0