Everything K-culture — comebacks to K-beauty, straight to your inboxGet it in your inbox

METAL MEDIA

Nine Emotion Centroids: A Label-Free Valence Axis That Transfers Across Four Modalities

arXiv:2608.180902026-08-20

Nine emotion words and 450 short stories are enough to find the 'positive vs negative' direction hiding inside AI models, and it turns out to be the same direction whether the AI is reading text, looking at pictures, hearing sounds, or reading brainwaves

Language models carry a single internal direction that tracks how positive or negative something feels, and this paper shows how to find it using just 9 emotion category names and about 450 short paragraphs instead of thousands of labeled examples. The same direction, found the same way, also shows up in models built for images, audio, and human brain recordings that were never trained together. Surgically deleting this direction from a language model's internal state causes sentiment classification to collapse, showing the direction isn't just correlated with sentiment but actually drives it.

METAL MEDIA explanatory visual

Nine emotion words and 450 short stories are enough to find the 'positive vs negative' direction hiding inside AI models, and it turns out to be the same direction whether the AI is reading text, looking at pictures, hearing sounds, or reading brainwaves

  1. 01Using only 9 emotion category names (anger, joy, fear, etc.) and about 50 short narrative paragraphs per emotion (450 total), the authors found a 'valence axis' (V-axis) using roughly 1,500 times fewer labels than the standard supervised approach.
  2. 02The recipe: feed the stories through a frozen (untrained-further) encoder, average the resulting vectors within each emotion to get 9 emotion centroids, then take the direction along which these 9 points spread out the most, using principal component analysis.
  3. 03This V-axis matched supervised classifiers within 7 percentage points of AUC across four different domains: text (Llama-3-8B, AUC 0.772, 93% of the supervised score of 0.828 on SST-2), images (EmoSet, correlation of 0.636 with human ratings), audio (ESC-50, AUC 0.906), and brain recordings (FACED EEG, AUC 0.720).
  4. 04Surgically removing the V-axis from a language model's internal state during processing dropped sentiment classification accuracy by 5.5 to 37.2 percentage points across three different models, while removing random directions of the same size only cost up to 0.88 points, showing the V-axis is actually used for sentiment judgments, not just correlated with them.
  5. 05A simple 2-parameter classifier trained only on text labels transferred directly to images (AUC 0.961), audio (0.764), and brain data (0.828) without ever seeing labels from those domains, far outperforming a generic 16-dimensional shared feature set that scored at chance level (0.525).
An explanatory diagram made by METAL MEDIA, not a figure supplied by the paper's authors.

What they did

  1. Using only 9 emotion category names (anger, joy, fear, etc.) and about 50 short narrative paragraphs per emotion (450 total), the authors found a 'valence axis' (V-axis) using roughly 1,500 times fewer labels than the standard supervised approach.
  2. The recipe: feed the stories through a frozen (untrained-further) encoder, average the resulting vectors within each emotion to get 9 emotion centroids, then take the direction along which these 9 points spread out the most, using principal component analysis.
  3. This V-axis matched supervised classifiers within 7 percentage points of AUC across four different domains: text (Llama-3-8B, AUC 0.772, 93% of the supervised score of 0.828 on SST-2), images (EmoSet, correlation of 0.636 with human ratings), audio (ESC-50, AUC 0.906), and brain recordings (FACED EEG, AUC 0.720).
  4. Surgically removing the V-axis from a language model's internal state during processing dropped sentiment classification accuracy by 5.5 to 37.2 percentage points across three different models, while removing random directions of the same size only cost up to 0.88 points, showing the V-axis is actually used for sentiment judgments, not just correlated with them.
  5. A simple 2-parameter classifier trained only on text labels transferred directly to images (AUC 0.961), audio (0.764), and brain data (0.828) without ever seeing labels from those domains, far outperforming a generic 16-dimensional shared feature set that scored at chance level (0.525).
Figure 1: V-axis ablation degrades sentiment readout in three LLMs; matched-norm random-direction ablation does not. Bars: drop in SST-2 dev accuracy (pp) from inference-time projection out of the residual stream of the V-axis (dark) vs. K=3 matched-norm random directions (light, error bar = std). Annotation: drop in pp. z is |V-drop|/σrandom. Each panel uses the model’s sentiment-optimal block; Qwen3-8B uses block 23 (depth 0.86), consistent with the reasoning-distillation depth shift (§7).
Figure 1: V-axis ablation degrades sentiment readout in three LLMs; matched-norm random-direction ablation does not. Bars: drop in SST-2 dev accuracy (pp) from inference-time projection out of the residual stream of the V-axis (dark) vs. K=3 matched-norm random directions (light, error bar = std). Annotation: drop in pp. z is |V-drop|/σrandom. Each panel uses the model’s sentiment-optimal block; Qwen3-8B uses block 23 (depth 0.86), consistent with the reasoning-distillation depth shift (§7).
Table 1: V-axis (label-free for text/image/audio, supervised-in-axis for EEG) recovers supervised-classifier valence within 7 pp AUC across four modalities. Recipe AUC: held-out AUC of σ​(⟨x,v1⟩) where v1 is the V-axis (text Pearson r for vision). Sup. AUC: a logistic-regression head trained on the modality’s full label set (nSST-2=6,920; nEmoSet=11,811; nESC-50=2,000; nFACED=123 subjects). Ratio: recipe/supervised. See §3.
ModalityEncoderDatasetRecipe AUCSup. AUCRatiop
TextLlama-3-8B-Inst (block 20)SST-20.7720.82893%—
TextQwen3-8B (block 31, depth 0.86)SST-20.7870.84094%—
VisionCLIP-img-768EmoSetr=+0.636r=+0.8179%null 0.112
AudioCLAP-aud-512ESC-500.9060.9496%2.2×10−15
EEGCBraMod-200FACED0.720±0.0550.8387%3.65×10−8
Figure 2: All 12/12 cross-modal cells transfer at AUC ≥0.70. Rows: source modality on which the 2-parameter logistic head was fitted (binary valence labels). Columns: target modality evaluated. Diagonal: 5-fold self-CV (ntext=8,872; nimage=5,905; naudio=1,040; nEEG=1,725). Off-diagonal: cross-modal, nsource∈{728,1034,4133,8000}, no target labels at the head-fitting stage. See §5.
Figure 2: All 12/12 cross-modal cells transfer at AUC ≥0.70. Rows: source modality on which the 2-parameter logistic head was fitted (binary valence labels). Columns: target modality evaluated. Diagonal: 5-fold self-CV (ntext=8,872; nimage=5,905; naudio=1,040; nEEG=1,725). Off-diagonal: cross-modal, nsource∈{728,1034,4133,8000}, no target labels at the head-fitting stage. See §5.
Table 2: V-axis directional ablation drops SST-2 sentiment classification by 5.5–37.2 percentage points across three LLMs (≥12​σ above matched-norm null in every row). Columns: Base/V-abl.: SST-2 dev-split accuracy (%) without/with V-axis projection ablation. Drop (V): V-ablation accuracy − baseline accuracy (pp). Random: mean±std drop over K=3 matched-norm random-direction draws. z=|Drop(V)|/σRandom. nval=872. Source: experiments/d31_causal_mediation/results/. See §4.
ModelBlockBase (%)V-abl. (%)Drop (V)Random (μ±σ)z
Llama-3-8B-Inst2087.9682.45−5.50 pp−0.15±0.05 pp109
Qwen3-1.7B1884.4068.58−15.83 pp−0.88±1.24 pp12
Qwen3-8B2387.6150.46−37.16 pp−0.08±0.19 pp196
Figure 3: V-axis recipe (blue) matches supervised heads (grey) within 7 pp AUC across four modalities; null directions (red dashed) sit at chance. Bars: V-axis vs. supervised performance per modality. Vision: Pearson r to crowdworker valence (EmoSet). Other modalities: held-out AUC. Same numbers as Table 1 in the main paper.
Figure 3: V-axis recipe (blue) matches supervised heads (grey) within 7 pp AUC across four modalities; null directions (red dashed) sit at chance. Bars: V-axis vs. supervised performance per modality. Vision: Pearson r to crowdworker valence (EmoSet). Other modalities: held-out AUC. Same numbers as Table 1 in the main paper.
Table 3: 4×4 V-axis cross-modal AUC matrix; all 12/12 off-diagonal cells ≥0.70. Each entry: held-out AUC of a 2-parameter logistic regression trained on source modality V-axis projections (binary valence) and evaluated on target modality projections. Diagonal: 5-fold CV self-AUC. Off-diagonal: cross-modal transfer with no target-modality labels at the head-fitting stage; sign per modality is fixed once from the source positive class (no off-diagonal sign search). Random-direction baselines per off-diagonal cell are 0.52–0.59. See §5.
Source ↓ Target →TextImageAudioEEG
Text0.741 (CV)0.9610.7640.828
Image0.7250.960 (CV)0.7640.828
Audio0.7250.9610.751 (CV)0.828
EEG0.7250.9610.7640.867 (CV)
Table 4: One sentiment-specific dimension beats 16 generic dimensions by 0.18–0.44 AUC for cross-modal sentiment transfer. All entries: held-out AUC of an SST-2-trained classifier evaluated on EmoSet image valence (ntest=1,772). The bridge in each row replaces the V-axis with the listed substrate. See §5.
Bridge between text and image encoderCross-modal AUC
Generic K=16 substrate (same encoder family)0.525 (chance)
Random K=16 subspace≈ chance
Cross-encoder-family substrate (CLIP-text + CLAP-audio)≈ chance
Raw 768-D CLIP-text features0.771
V-axis (1-D, sentiment-specific)0.961

Why it matters

Finding that a vague human quality like emotional tone can be pinpointed inside AI systems using only a handful of examples, and that this same direction is shared across text, images, sound, and even brain activity, suggests emotion-aware AI tools could become much cheaper and faster to build. At the same time, the finding that this same trick can be used to steer text generation toward positive or negative tone in some model families (Llama, Mistral) but not others (Qwen, Gemma) raises concerns about misuse for manipulating AI outputs.

Terms in this paper

  • Valence axis (V-axis) · A single internal direction inside an AI model that tracks how positive or negative something is
  • Residual stream · The running internal state that a transformer model builds up layer by layer as it processes input
  • Principal component analysis (PCA) · A statistical method that finds the direction along which a set of data points varies the most
  • AUC · A score measuring how well a classifier distinguishes correct from incorrect answers; 1.0 is perfect, 0.5 is random guessing
  • Directional ablation · An experimental technique that forcibly removes a specific direction's contribution from a model's internal state

Original abstract (English)

Inside a modern language model sits a single internal direction that tracks how positive or negative a sentence feels. We show how to find this valence axis (V-axis) from just 9 emotion category names plus 50 short narrative paragraphs per emotion -- about 1,500 fewer labels than the usual supervised approach -- and that the same direction appears in vision, audio, and human-brain encoders never jointly trained. The recipe: embed nine emotion-anchored story sets in a frozen encoder, take the top principal direction of the nine averaged embeddings. Projecting new inputs onto it captures 93% of supervised performance on SST-2 (Llama-3-8B-Instruct, AUC 0.772 vs. 0.828), correlates with human valence ratings on 11,811 EmoSet images at r=0.636, reaches AUC 0.906 on ESC-50 audio (p 12). A 2-parameter classifier trained on text labels transfers to images (AUC 0.961), audio (0.764), and brain recordings (0.828) without target-modality labels; a generic 16-D subspace stays at chance (0.525). The recipe is bounded to continuous attributes -- seven tests on categorical concepts return near-chance -- and steering is family-specific (Llama/Mistral yes, Qwen/Gemma no).

Authors · Yousef Radwan

Read on arXiv

Latest papers

All papers →

Latest from METAL MEDIA

Figures: Yousef Radwan et al., arXiv:2608.18090, CC BY 4.0