Is AgentPoison superseded?

AgentPoison (Retrieval-augmented generation): superseded — cited as a baseline and beaten by newer methods. 1 paper(s) critique it, 1 beat it on benchmarks — #113 of 1179 most-superseded. Sub-problem: cluster led by PoisonedRAG. Newer alternatives in the same sub-problem include DiscourseFlip, SilentRetrieval, Deceptive Evolutionary Jamming Attack (DEJA), LogicPoison, KEPo.

Method Drift›Retrieval-augmented generation

Superseded baseline#113 of 1,179 most-superseded

AgentPoison

AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases

Retrieval-augmented generation · first seen Jul 17, 2024

superseded — cited as a baseline and beaten by newer methods

1 papers critique it · 1 beat it on benchmarks

What papers say

Verbatim critique sentences, each from a paper that cites AgentPoison as a baseline.

“these methods inevitably introduce abnormal inference behaviors and new security risks to the deployed LLMs as these distinctive behaviors are generating incorrect results on particular verification prompts/questions”
— Towards Copyright Protection for Knowledge Bases of Retrieval-augmented Language Models via Reasoning

Beaten on benchmarks

Head-to-head results where a newer method reports beating AgentPoison. Values are copied from the source paper's tables — verify against the cited paper.

[name]-O beats AgentPoison · H [NQ dataset]
0.17 vs 0.87
Towards Copyright Protection for Knowledge Bases of Retrieval-augmented Language Models via Reasoning
[name]-O beats AgentPoison · H [HotpotQA dataset]
0.10 vs 0.86
Towards Copyright Protection for Knowledge Bases of Retrieval-augmented Language Models via Reasoning
[name]-O beats AgentPoison · H [MS-MARCO dataset]
0.15 vs 0.85
Towards Copyright Protection for Knowledge Bases of Retrieval-augmented Language Models via Reasoning

Newer alternatives

Recent methods in the same sub-problem, not yet superseded in the knowledge base.