이미지와 상관없는 텍스트 한 줄만 끼워 넣어도 멀티모달 AI 답이 규칙적으로 흔들린다

arXiv:2608.192082026-08-21

When Irrelevant Text Matters: Affine Margin Shifts in Multimodal Large Language Models

연구팀은 이미지와 질문에 아무 상관 없는 문장을 끼워 넣었을 때 멀티모달 대형언어모델(MLLM)이 어떻게 반응하는지 실험했다. 그 결과 정답 확률의 차이(디시전 마진)가 무작위로 흔들리는 게 아니라 일정한 1차 함수 형태로 변형된다는 규칙을 발견했다. 이 규칙을 이용해 답을 원래대로 되돌리는 간단한 보정법도 제시했다.

METAL MEDIA 해설 도표

이미지와 상관없는 텍스트 한 줄만 끼워 넣어도 멀티모달 AI 답이 규칙적으로 흔들린다

01POPE, AMBER, MME, GQA 등 예/아니오로 답하는 벤치마크에서 이미지와 무관한 위키텍스트 문장을 질문 뒤에 붙이는 실험을 LLaVA-1.5-7B, Qwen2-VL(2B·7B), InternVL3-8B에 적용했다.
02정답이 'Yes'일 확률과 'No'일 확률의 로그값 차이를 '디시전 마진'으로 정의해 측정한 결과, 무관한 텍스트를 넣기 전후의 마진이 mc≈a·m0+b라는 1차 함수(어파인 변환) 관계를 매우 높은 적합도(R²)로 따랐다.
03무관한 문장을 '이미지와 관련 있을 수도 있다'는 문구와 함께 제시하면 기울기(a)가 크게 줄어 원래 판단이 더 많이 흐트러졌고, 절편(b)은 항상 음수여서 답을 '아니오' 쪽으로 밀어붙이는 경향이 일관되게 나타났다.
04원래 마진이 0에 가까워 애매했던 샘플일수록 답이 뒤집힐 확률(플립율)이 훨씬 높았고, 이 어파인 관계를 거꾸로 이용해 보정하자 검증 세트에서 정확도와 F1이 크게 회복되고 플립율도 크게 줄었다.
05이미지 설명을 자유롭게 생성하는 과제에서도 무관한 텍스트를 넣으면 모델이 눈에 띄는 대상만 언급하고 주변 사물은 빼먹는, 더 보수적인 답변을 내놓는 경향이 확인됐다.

METAL MEDIA이 원문을 바탕으로 재구성한 해설 도표이며, 논문 저자의 원문 figure가 아닙니다.

무엇을 했나

POPE, AMBER, MME, GQA 등 예/아니오로 답하는 벤치마크에서 이미지와 무관한 위키텍스트 문장을 질문 뒤에 붙이는 실험을 LLaVA-1.5-7B, Qwen2-VL(2B·7B), InternVL3-8B에 적용했다.
정답이 'Yes'일 확률과 'No'일 확률의 로그값 차이를 '디시전 마진'으로 정의해 측정한 결과, 무관한 텍스트를 넣기 전후의 마진이 mc≈a·m0+b라는 1차 함수(어파인 변환) 관계를 매우 높은 적합도(R²)로 따랐다.
무관한 문장을 '이미지와 관련 있을 수도 있다'는 문구와 함께 제시하면 기울기(a)가 크게 줄어 원래 판단이 더 많이 흐트러졌고, 절편(b)은 항상 음수여서 답을 '아니오' 쪽으로 밀어붙이는 경향이 일관되게 나타났다.
원래 마진이 0에 가까워 애매했던 샘플일수록 답이 뒤집힐 확률(플립율)이 훨씬 높았고, 이 어파인 관계를 거꾸로 이용해 보정하자 검증 세트에서 정확도와 F1이 크게 회복되고 플립율도 크게 줄었다.
이미지 설명을 자유롭게 생성하는 과제에서도 무관한 텍스트를 넣으면 모델이 눈에 띄는 대상만 언급하고 주변 사물은 빼먹는, 더 보수적인 답변을 내놓는 경향이 확인됐다.

Figure 1: Overview of the controlled intervention and its behavioral effects. (a) For each image-question pair, we compare a context-free input with a paired context-conditioned input, where an irrelevant context is inserted while the prompt structure is kept unchanged. (b) Across multiple benchmarks, irrelevant context not only reduces predictive accuracy, but also shifts model decisions toward negative responses.

Table 1: Behavioral effects of image-irrelevant context across datasets and models. Irrelevant context generally degrades performance, induces a negative-response shift, and has stronger effects when presented as potentially image-related. Free indicates the context-free condition, while ΔNeu. and ΔCon. report changes under the context-neutral and context-condition setting relative to context-free condition. Yes Rate reports the proportion of positive responses among all answers, indicating the model’s tendency toward affirmative predictions. Flip Rate reports the percentage of samples whose prediction changes. All values are reported in percentage points.
Dataset	Model	Accuracy	Recall	Yes Rate	Flip Rate
Free	ΔNeu.	ΔCon.	Free	ΔNeu.	ΔCon.	Free	ΔNeu.	ΔCon.	Neu.	Con.
MME	LLaVA-1.5-7B	78.5	↑0.1	\cellcolorgray!10↓0.9	80.5	↓7.9	\cellcolorgray!10↓8.4	51.9	↓7.9	\cellcolorgray!10↓7.4	9.0	\cellcolorgray!109.8
Qwen2-VL-2B	79.9	↓10.6	\cellcolorgray!10↓20.8	80.5	↓24.6	\cellcolorgray!10↓40.8	48.7	↓16.8	\cellcolorgray!10↓26.4	20.5	\cellcolorgray!1033.4
Qwen2-VL-7B	87.6	↑0.2	\cellcolorgray!10↓27.5	90.6	↓2.6	\cellcolorgray!10↓69.5	52.7	↓2.8	\cellcolorgray!10↓41.7	4.3	\cellcolorgray!1042.0
InternVL3	87.9	↓3.1	\cellcolorgray!10↓3.7	85.3	↓9.9	\cellcolorgray!10↓10.5	47.3	↓7.0	\cellcolorgray!10↓7.0	7.8	\cellcolorgray!107.9
GQA	LLaVA-1.5-7B	76.4	→0.0	\cellcolorgray!10↓1.9	76.4	↑2.2	\cellcolorgray!10↑7.0	50.7	↑2.3	\cellcolorgray!10↑9.1	7.6	\cellcolorgray!1014.3
Qwen2-VL-2B	79.2	↓6.3	\cellcolorgray!10↓6.2	76.1	↓20.1	\cellcolorgray!10↓18.4	47.6	↓14.3	\cellcolorgray!10↓12.6	16.0	\cellcolorgray!1015.6
Qwen2-VL-7B	82.2	↓1.4	\cellcolorgray!10↓19.8	78.7	↓2.8	\cellcolorgray!10↓48.3	47.4	↓1.6	\cellcolorgray!10↓29.9	3.9	\cellcolorgray!1030.0
InternVL3	81.9	↓1.5	\cellcolorgray!10↓2.0	85.1	↓4.3	\cellcolorgray!10↓6.1	54.2	↓2.9	\cellcolorgray!10↓4.2	8.0	\cellcolorgray!109.4
AMBER	LLaVA-1.5-7B	81.2	↓0.3	\cellcolorgray!10↓1.3	64.8	↓2.4	\cellcolorgray!10↓2.3	28.8	↓1.3	\cellcolorgray!10↓2.9	6.3	\cellcolorgray!105.7
Qwen2-VL-2B	85.3	↓0.7	\cellcolorgray!10↓4.9	78.5	↓9.8	\cellcolorgray!10↓21.6	33.9	↓5.9	\cellcolorgray!10↓10.8	7.2	\cellcolorgray!1012.3
Qwen2-VL-7B	86.9	↑0.5	\cellcolorgray!10↓9.4	81.2	↓2.0	\cellcolorgray!10↓43.1	34.1	↓1.8	\cellcolorgray!10↓19.7	2.9	\cellcolorgray!1019.7
InternVL3	88.3	↑0.5	\cellcolorgray!10↑0.1	85.7	↓4.7	\cellcolorgray!10↓6.0	35.8	↓3.7	\cellcolorgray!10↓4.2	5.6	\cellcolorgray!106.0
POPE	LLaVA-1.5-7B	85.5	↓0.7	\cellcolorgray!10↓0.3	76.6	↓2.4	\cellcolorgray!10↓0.9	41.4	↓1.8	\cellcolorgray!10↓0.6	2.3	\cellcolorgray!102.3
Qwen2-VL-2B	87.8	↓1.8	\cellcolorgray!10↓2.0	79.6	↓4.5	\cellcolorgray!10↓5.1	42.1	↓2.8	\cellcolorgray!10↓3.2	3.3	\cellcolorgray!103.6
Qwen2-VL-7B	88.3	↓1.3	\cellcolorgray!10↓8.4	81.1	↓3.4	\cellcolorgray!10↓19.8	43.1	↓2.1	\cellcolorgray!10↓11.6	2.6	\cellcolorgray!1011.6
InternVL3	90.9	↓0.8	\cellcolorgray!10↓0.3	90.7	↓5.3	\cellcolorgray!10↓3.9	50.2	↓4.5	\cellcolorgray!10↓3.6	4.8	\cellcolorgray!104.1

Figure 2: Illustration of the margin-level analysis. (a) The decision margin is defined as the log-probability difference between the positive and negative answers. (b) Adding irrelevant context transforms the context-free margin m0 into the context-conditioned margin mc, which follows an approximate affine relation mc≈am0+b. (c) The affine transformation shifts the effective decision boundary from m0=0 to m0=−b/a. This shift expands the Negative Region and compresses the Positive Region. As a result, samples in the Flip Region, i.e., 0<m0<−b/a, are likely to change from positive to negative predictions, inducing a systematic shift in decision preference.

Table 2: Fitted affine parameters across models and benchmarks. The affine relationship exhibits consistently high goodness of fit, indicating that such affine is structural and stable.
Model	Dataset	a	b	R2	r
LLaVA-1.5-7B	POPE	0.55	-1.05	0.90	0.95
AMBER	0.52	-1.15	0.79	0.89
MME	0.54	-1.08	0.83	0.91
GQA	0.48	-0.92	0.74	0.86
Qwen2-VL-2B	POPE	0.56	-1.58	0.86	0.93
AMBER	0.59	-1.61	0.86	0.93
MME	0.56	-1.13	0.74	0.86
GQA	0.62	-1.55	0.78	0.88

Figure 3: Visualization of three input conditions. These three conditions represent different degrees to which the irrelevant context is framed as potentially image-related.

Table 3: In-domain post-hoc affine calibration under WikiText-after-possibly context. Affine parameters are fitted on calibration splits and evaluated on held-out test splits. We report the Accuracy and Flip rate with percentage.
Dataset	Origin	Con.	Cal.	Con. Flip	Cal. Flip
POPE	86.1	78.0	84.6	16.6	6.1
AMBER	82.7	74.9	79.7	29.2	13.6
MME	78.7	68.5	76.5	30.2	12.6
GQA	73.2	69.2	72.3	36.3	14.8

Figure 4: Affine margin patterns for LLaVA-1.5-7B across four benchmarks. Each panel plots the context-free margin mo against the context-conditioned margin mc. Points are colored by prediction transitions between the two conditions, and the solid line shows the fitted affine relation mc=amo+b; the dashed line denotes the identity relation mc=mo. The consistently high R2 and correlation values indicate that textual context induces a structured affine transformation of the original decision margin rather than unstructured perturbations. Notably, changing the semantic framing from Neutral to Condition substantially decreases the fitted slope a, while leaving the negative offset b largely stable. Results are shown for LLaVA.

Table 4: Cross-dataset affine calibration transfer result. Affine parameters are fitted on POPE and directly applied to other benchmarks without target calibration samples. We report the Accuracy and Flip rate with percentage.
Dataset	Origin	Con.	Cal.	Con. Flip	Cal. Flip
AMBER	82.7	75.0	80.1	29.1	14.7
MME	78.7	68.5	76.6	30.4	12.8
GQA	73.2	69.3	71.7	36.2	13.1

Figure 6: Experiment results for Validating the Parameter Interpretation. Points are colored by ground-truth label. Arrows show the mean label-conditioned margin shift from the identity line to the observed context-conditioned mean. The monotonic trend asup>airr>aconf is consistent with the interpretation of a as commitment preservation.

Table 5: Absolute behavioral metrics across tested models and benchmarks. Free denotes context-free input, Neutral denotes WikiText-after-neutral, and Condition denotes WikiText-after-possibly. Part (b) reports the original-style MME score.
Model	Dataset	Free	Neutral	Condition
Acc	F1	Rec.	Prec.	Acc	F1	Rec.	Prec.	Acc	F1	Rec.	Prec.
LLaVA-1.5-7B	POPE	85.5	84.2	76.6	93.5	84.8	83.2	74.2	94.6	85.2	83.8	75.7	93.8
LLaVA-1.5-7B	AMBER	81.2	69.8	64.8	75.8	80.9	68.7	62.4	76.5	79.9	69.2	67.1	71.4
LLaVA-1.5-7B	MME	78.5	78.9	80.5	77.4	78.6	77.2	72.6	82.5	77.6	76.3	72.1	81.0
LLaVA-1.5-7B	GQA-Binary	76.4	76.9	76.4	77.5	76.4	77.4	78.6	76.3	74.5	77.1	83.4	71.7
Qwen2-VL-2B	POPE	87.8	86.8	79.6	95.5	86.0	84.5	75.1	96.4	85.8	84.1	74.5	96.7
Qwen2-VL-2B	AMBER	85.3	78.3	78.5	78.1	84.6	75.1	68.7	82.7	80.4	66.2	56.9	79.1
Qwen2-VL-2B	MME	79.9	80.1	80.5	79.6	69.3	64.6	55.9	76.4	59.1	49.3	39.7	65.0
Qwen2-VL-2B	GQA-Binary	79.2	79.0	76.1	82.1	72.9	68.0	56.0	86.6	73.0	68.7	57.7	84.9
Qwen2-VL-7B	POPE	88.3	87.5	81.1	95.0	87.0	85.8	77.7	95.7	79.9	75.5	61.3	98.4
Qwen2-VL-7B	AMBER	86.9	80.7	81.2	80.2	87.4	80.9	79.2	82.7	77.5	53.3	38.1	88.8
Qwen2-VL-7B	MME	87.6	88.0	90.6	85.5	87.8	87.8	88.0	87.7	60.1	34.6	21.1	95.4
Qwen2-VL-7B	GQA-Binary	82.2	82.0	78.7	85.5	80.8	80.3	75.9	85.2	62.4	45.4	30.4	89.6
InternVL3	POPE	90.9	91.0	90.7	91.3	90.1	89.7	85.4	94.4	90.6	90.3	86.8	94.1
InternVL3	AMBER	88.3	83.1	85.7	80.6	88.8	82.9	81.0	84.9	88.4	82.2	79.7	84.9
InternVL3	MME	87.9	87.6	85.3	90.0	84.8	83.2	75.4	92.7	84.2	82.6	74.8	92.1
InternVL3	GQA-Binary	81.9	82.9	85.1	80.8	80.4	80.9	80.8	81.0	79.9	80.2	79.0	81.4

Figure 7: The affine transformation results across all models and benchmarks.

Table 6: In-domain post-hoc affine calibration under WikiText-after-possibly context. Affine parameters are fitted on calibration splits and evaluated on held-out test splits. Values are percentages averaged over five splits. Flip is relative to Origin predictions.
Model	Dataset	Origin Acc.	Context Acc.	Cal. Acc.	Origin F1	Context F1	Cal. F1	Context Flip	Cal. Flip
LLaVA-1.5-7B	POPE	86.1	78.0	84.6	85.6	72.6	83.2	16.6	6.1
LLaVA-1.5-7B	AMBER	82.7	74.9	79.7	77.5	47.3	71.0	29.2	13.6
LLaVA-1.5-7B	MME	78.7	68.5	76.5	79.2	56.5	76.4	30.2	12.6
LLaVA-1.5-7B	GQA-Binary	73.2	69.2	72.3	77.7	63.5	75.8	36.3	14.8

Figure 8: Residual diagnostics for the affine fit under the WikiText-after-possibly context. Columns denote benchmarks and rows denote models. Each point is a sample residual mc−(am0+b); the red curve is the binned mean residual. All panels use shared symmetric axes so that residual dispersion is directly comparable.

Table 7: Cross-dataset affine calibration transfer on LLaVA-1.5-7B under WikiText-after-possibly context. Source-fitted parameters are applied directly to the target benchmark without target calibration samples. Values are percentages.
Source	Target	Origin Acc.	Cal. Acc.	Origin F1	Cal. F1	Origin Flip	Cal. Flip
POPE	AMBER	75.0	80.1	47.7	70.3	29.1	14.7
POPE	MME	68.5	76.6	56.4	76.2	30.4	12.8
POPE	GQA-Binary	69.3	71.7	63.6	75.9	36.2	13.1
AMBER	POPE	78.2	85.2	72.8	84.0	16.5	5.2
AMBER	MME	68.5	76.5	56.4	77.0	30.4	12.4
AMBER	GQA-Binary	69.3	70.3	63.6	75.6	36.2	12.0
MME	POPE	78.2	84.9	72.8	83.6	16.5	5.6
MME	AMBER	75.0	80.2	47.7	70.9	29.1	14.1
MME	GQA-Binary	69.3	71.0	63.6	75.7	36.2	12.4
GQA-Binary	POPE	78.2	84.3	72.8	82.5	16.5	7.2
GQA-Binary	AMBER	75.0	79.9	47.7	68.4	29.1	16.4
GQA-Binary	MME	68.5	76.2	56.4	74.8	30.4	14.0

Figure 9: A case of our open-ended generation experiment. We use the green mask to indicate the region covered by the model’s prediction under the context-condition setting. After adding irrelevant context, the model tends to describe only salient objects in the image, while peripheral objects are no longer mentioned.

Table 8: Prompt, template, length, and source ablations on POPE with LLaVA-1.5-7B. Acc, Recall, YesRate, and Flip are reported in percentages.
Group	Variant	a	b	R2	Acc	Recall	Flip
Position/template	Wiki before + possibly	0.726	-0.041	0.943	86.4	82.8	3.7
	Wiki after + possibly	0.554	-1.046	0.896	78.2	57.8	16.5
	Wiki before + neutral	0.755	0.084	0.949	86.2	82.7	3.7
	Wiki after + neutral	0.706	-1.243	0.921	80.1	61.6	14.5
Template only	After + possibly	0.583	-0.910	0.944	80.8	63.3	13.5
	After + neutral	0.819	-0.455	0.976	85.1	74.3	6.7
Length	Short Wiki	0.699	-0.000	0.940	86.3	82.4	4.1
	Medium Wiki	0.726	-0.041	0.943	86.4	82.8	3.7
	Long Wiki	0.743	-0.150	0.934	86.3	82.2	4.2
Source/shuffle	Shuffled Wiki	0.796	0.037	0.965	86.7	82.8	3.2
	COCO caption before	0.617	0.192	0.896	85.7	84.7	6.0
	COCO caption after	0.475	-1.204	0.892	74.2	49.7	20.7

Table 9: Label-verbalization controls on POPE with LLaVA-1.5-7B. For each verbalizer pair, margins score the semantically affirmative token against the negative token. Behavioral metrics and Flip are percentages; affine quantities are fitted between Origin and each context condition.
Verbalizer	Condition	Acc	F1	YesRate	Flip	a	b	R2	r
Yes/No	Origin	86.4	86.1	47.1	–	–	–	–	–
Neutral	73.5	64.7	24.7	22.4	0.481	-1.229	0.854	0.924
Possibly	75.3	68.0	26.8	20.4	0.384	-0.871	0.836	0.914
True/False	Origin	85.6	84.7	44.1	–	–	–	–	–
Neutral	80.9	82.5	58.7	16.5	0.600	0.587	0.791	0.889
Possibly	62.5	72.7	86.6	42.6	0.510	1.124	0.747	0.864

Table 10: Natural verbalizer control on AMBER discriminative with LLaVA-1.5-7B using True/False. Behavioral metrics and Flip are reported in percentages.
Condition	Acc	Yes	Flip	a	b	R2
Origin	77.4	26.9	–	–	–	–
Neutral	68.8	58.7	32.9	0.58	0.61	0.66
Possibly	48.4	84.2	57.4	0.47	1.04	0.57

Table 11: Context-role intervention on POPE with LLaVA-1.5-7B. Δm+ and Δm− denote the mean shift mc−m0 for ground-truth Yes and No samples, respectively.
Context	a	b	R2	Δm+	Δm−
Irrelevant	0.554	-1.046	0.896	-1.96	0.16
Supporting	0.626	-0.287	0.873	-0.94	0.61
Conflicting	0.367	-1.228	0.869	-2.63	0.59

Table 12: Context-only prior subtraction on POPE with LLaVA-1.5-7B. We report the affine fit between m0 and the prior-subtracted margin msub=mc−mprior. Acc, F1, YesRate, and Flip are reported in percentages.
Context	Prior estimator	a	b	R2	r	Acc	F1	YesRate	Flip
neutral	context-only blank	0.705	-0.872	0.898	0.948	81.7	78.5	34.5	11.4
neutral	question+context blank	0.700	1.894	0.904	0.951	79.7	82.4	64.9	19.1
neutral	context-only same image	0.705	-0.653	0.902	0.950	82.7	80.0	35.9	10.0
possibly	context-only blank	0.552	-0.233	0.868	0.932	83.3	81.3	38.5	8.2
possibly	question+context blank	0.549	1.599	0.872	0.934	75.5	79.7	70.0	24.3
possibly	context-only same image	0.551	0.103	0.862	0.928	84.8	83.5	41.9	6.4

Table 13: Nested margin-model comparison on POPE with LLaVA-1.5-7B. The context variant is WikiText-after-neutral. Fit metrics evaluate mc prediction on held-out samples. Calibration metrics evaluate the corrected margin as a binary prediction.
Model	R2	MAE	Flip F1	Calib Acc	Calib F1	Calib Flip
Identity	0.522	1.337	0.000	0.800	0.756	0.145
Shift-only	0.760	0.934	0.711	0.854	0.841	0.054
Scale-only	0.642	1.254	0.000	0.800	0.756	0.145
Full affine	0.920	0.518	0.849	0.855	0.842	0.050

Table 14: Local margin analysis under WikiText-after-possibly. For each model and dataset, we report the global affine fit and the flip rate within low-, mid-, and high-margin regions. Flip rates are percentages.
Model	Dataset	Global a	Global R2	Trim R2	Low Flip	Mid Flip	High Flip
LLaVA	POPE	0.554	0.896	0.899	42.2	6.4	0.1
LLaVA	AMBER	0.525	0.786	0.785	52.4	31.6	2.6
LLaVA	MME	0.542	0.830	0.805	52.1	33.0	5.3
LLaVA	GQA	0.476	0.743	0.691	56.3	42.3	9.6
Qwen2-2B	POPE	0.557	0.859	0.841	42.6	15.4	3.1
Qwen2-2B	AMBER	0.592	0.863	0.848	46.0	18.7	3.0
Qwen2-2B	MME	0.561	0.740	0.730	42.8	21.7	5.9
Qwen2-2B	GQA	0.615	0.775	0.750	53.6	33.0	5.5

Table 15: Random-context-seed robustness on POPE with LLaVA-1.5-7B under the WikiText-after-possibly condition. Behavioral metrics and Flip are reported in percentages.
Seed	a	b	R2	r
13	0.5541	-1.0441	0.8968	0.9470
21	0.5536	-1.0492	0.8952	0.9461
Mean	0.5539	-1.0466	0.8960	0.9466
Std.	0.0003	0.0036	0.0012	0.0006

Table 16: GQA-Judgment behavior and affine fit for LLaVA under the WikiText-after-possibly context. Origin accuracy is evaluated without irrelevant context, while context metrics are evaluated after inserting irrelevant context.
Affine Fit	Behavior
Metric	Value	Metric	Value
Slope a	0.336	Origin Acc.	81.3
Intercept b	-1.377	Context Acc.	61.6
R2	0.580	Context F1	40.4
Pearson r	0.762	Yes Rate	14.5
		Flip Rate	32.1

Table 17: AMBER generative evaluation with LLaVA-1.5-7B. Free and Condition denote context-free and context-conditioned generation, respectively. Hal., Cov., Cog., and Len. denote hallucination rate, object coverage, cognitive error, and average output length.
Setting	CHAIR ↓	Cov. ↑	Hal. ↓	Cog. ↓	Len.
Free	7.9	49.4	33.3	4.0	68.1
Condition	3.8	39.3	9.5	0.7	16.1

왜 중요한가

챗봇이나 검색 결합형 AI에 문서, 대화 기록 같은 부가 텍스트가 섞여 들어가는 것은 실제 서비스에서 흔한 일인데, 이 연구는 그런 무관한 텍스트가 이미지 기반 판단을 예측 가능한 방식으로 왜곡시킨다는 것을 처음으로 수치화해 보여준다. 이는 멀티모달 AI를 실제 제품에 쓸 때 신뢰성을 점검하고 보정하는 구체적인 방법을 제시한다는 점에서 중요하다.

이 논문의 용어

MLLM(멀티모달 대형언어모델) · 이미지와 텍스트를 함께 이해하고 답을 생성하는 AI 모델
디시전 마진 · 정답 후보 두 개(예/아니오) 중 어느 쪽에 더 확신을 갖는지를 확률 차이로 나타낸 값
어파인 변환 · y=ax+b 형태처럼 기존 값을 일정한 비율로 늘리고 일정하게 밀어내는 1차 함수 변형
플립율 · 무관한 텍스트를 넣기 전후로 모델의 답(예/아니오)이 뒤바뀐 샘플의 비율
포스트혹 보정 · 모델을 다시 학습시키지 않고, 추론 후 결과값만 수식으로 되돌려 교정하는 방법

본문에 싣지 못한 그림

Figure 5: Flip rate across context-free margin bins. Samples with smaller |m0| are much more likely to change their predictions after adding irrelevant context. This indicates that context-induced flips are concentrated near the original decision boundary.

원문에서 그림 보기 →

저자 · Yinfeng Wang, Zhiyuan Yao, Zheren Fu, Lei Zhang, Zhendong Mao

arXiv에서 원문 보기

METAL MEDIA 최신 기사

그림 출처: Yinfeng Wang et al., arXiv:2608.19208, CC BY 4.0

이미지와 상관없는 텍스트 한 줄만 끼워 넣어도 멀티모달 AI 답이 규칙적으로 흔들린다

이미지와 상관없는 텍스트 한 줄만 끼워 넣어도 멀티모달 AI 답이 규칙적으로 흔들린다

무엇을 했나

왜 중요한가

이 논문의 용어

본문에 싣지 못한 그림

최신 논문

METAL MEDIA 최신 기사