NegEval-Audio

Audio-language embedding models like CLAP fail to understand negation, causing performance to drop below chance on tasks that require identifying the absence of a sound, according to a new evaluation …

Audio-language models like CLAP fail to handle negation, with accuracy on negation tasks dropping below chance levels, according to a new evaluation framework called NegEval-Audio. Researchers found t…