HiCaM: A Hierarchical-Causal Modification Framework for Long-Form Text Modification
This addresses a specific issue in text editing for users needing coherent long-form modifications, representing a domain-specific incremental improvement.
The paper tackled the problem of LLMs making inappropriate or missing necessary modifications in long-form text editing by proposing HiCaM, a hierarchical-causal framework, which achieved up to a 79.50% win rate over strong LLMs in evaluations.
Large Language Models (LLMs) have achieved remarkable success in various domains. However, when handling long-form text modification tasks, they still face two major problems: (1) producing undesired modifications by inappropriately altering or summarizing irrelevant content, and (2) missing necessary modifications to implicitly related passages that are crucial for maintaining document coherence. To address these issues, we propose HiCaM, a Hierarchical-Causal Modification framework that operates through a hierarchical summary tree and a causal graph. Furthermore, to evaluate HiCaM, we derive a multi-domain dataset from various benchmarks, providing a resource for assessing its effectiveness. Comprehensive evaluations on the dataset demonstrate significant improvements over strong LLMs, with our method achieving up to a 79.50\% win rate. These results highlight the comprehensiveness of our approach, showing consistent performance improvements across multiple models and domains.