PSG-Agent: Personality-Aware Safety Guardrail for LLM-based Agents
This addresses safety issues for users of LLM-based agents in critical applications by enabling personalized and continuous monitoring, though it is incremental as it builds on existing guardrail methods.
The paper tackled the problem of uniform and isolated guardrails for LLM-based agents by proposing PSG-Agent, a personalized and dynamic system that mines interaction history and monitors across the agent pipeline, significantly outperforming existing guardrails like LlamaGuard3 and AGrail in scenarios such as healthcare and finance.
Effective guardrails are essential for safely deploying LLM-based agents in critical applications. Despite recent advances, existing guardrails suffer from two fundamental limitations: (i) they apply uniform guardrail policies to all users, ignoring that the same agent behavior can harm some users while being safe for others; (ii) they check each response in isolation, missing how risks evolve and accumulate across multiple interactions. To solve these issues, we propose PSG-Agent, a personalized and dynamic system for LLM-based agents. First, PSG-Agent creates personalized guardrails by mining the interaction history for stable traits and capturing real-time states from current queries, generating user-specific risk thresholds and protection strategies. Second, PSG-Agent implements continuous monitoring across the agent pipeline with specialized guards, including Plan Monitor, Tool Firewall, Response Guard, Memory Guardian, that track cross-turn risk accumulation and issue verifiable verdicts. Finally, we validate PSG-Agent in multiple scenarios including healthcare, finance, and daily life automation scenarios with diverse user profiles. It significantly outperform existing agent guardrails including LlamaGuard3 and AGrail, providing an executable and auditable path toward personalized safety for LLM-based agents.