Omni-Woodpecker: Hallucination Correction via Evidence-Prior Rebalancing for Omni LLMs
Zijian Liu, Chaoyou Fu, Yan Yang, Caifeng Shan, Ran He · Nanjing University
19 Oct 2026 · cs.AI, cs.CL, cs.CV, cs.MM · single gpu · code · reasoning & test-time compute, multimodal, evaluation & benchmarks
16 hf upvotes · 0 hn points, 0 comments · 113 stars · 0 citations
Recent Omni LLMs (OLLMs) have demonstrated remarkable capabilities in joint audio-visual reasoning, yet cross-modal hallucinations remain a major challenge. Existing mitigation methods mainly operate at the output level, overlooking the entanglement of grounding evidence and learned priors within fused representations. To address this issue, we propose Omni-Woodpecker (OWP), a training-free framework that shifts hallucination mitigation from output-level manipulation to conflict-conditioned representation rebalancing. Specifically, OWP first identifies cross-modal conflicts from complementary modality-specific views. It then employs orthogonal decomposition to separate grounding evidence from competing priors within the hidden states. Finally, OWP adaptively rebalances fused representations by suppressing misleading priors and restoring ignored evidence before decoding. Extensive experiments demonstrate the effectiveness and strong cross-architecture generalization of OWP. Using Qwen2.5-Omni-7B as the backbone, OWP improves performance by 12.9 and 8.6 points on CMM and AVHBench, respectively, while consistently achieving gains of 0.67-2.25 points across four general OLLM reasoning benchmarks. Furthermore, OWP generalizes effectively to VideoLLaMA2-AV, improving performance by 4.6 and 3.9 points on the same benchmarks. Code is publicly available at https://github.com/ZiiJianLiu/Omni-Woodpecker
Compute: single gpu. Inference-only on 7B Omni LLMs; evaluated on CMM and AVHBench; authors used RTX A6000.
Paper's setup: RTX A6000 (used for latency measurements). Smallest run that tests the claim: Qwen2.5-Omni-7B inference-only OWP evaluation on CMM (1,200 cases) and AVHBench (5,302 examples) (~8 GPU-hours on one A100-class GPU).
“Latency was measured per input on an RTX A6000 and averaged over three runs.”
(read from the paper's full text by Claude)
Potential
signals behind the hidden gems rankingfrom nanjinguniv, whose recent “VibeGame: Prompt-to-Game Development with AI-Native Engine a…” drew 25 upvotes/points
Existing reproductions
0 likely reproductions · 2 repos mention it · 0 HF models · checked 04/11/2026
- ZiiJianLiu/Omni-Woodpecker
Official implementation of "Omni-Woodpecker: Hallucination Correction via Evidence-Prior Rebalancing for Omni LLMs"
112★
official
Comments