Bridging the Editing Gap in LLMs: FineEdit for Precise and Targeted Text Modifications (original) (raw)
Abstract:Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating strong capabilities in tasks such as text generation, summarization, and reasoning. Recently, their potential for automating precise text editing tasks across specialized domains, such as programming code, LaTeX, and structured database languages, has gained attention. However, current state-of-the-art LLMs still struggle with executing precise, instruction-driven edits, particularly when structural accuracy and strict adherence to domain conventions are required. To address these challenges, we introduce InstrEditBench, an automated benchmark dataset comprising over 30,000 structured editing tasks spanning diverse domains, including Wikipedia articles, LaTeX documents, source code, and database languages. Using this benchmark, we develop FineEdit, a specialized editing model explicitly trained for accurate, context-aware text modifications. Experimental evaluations demonstrate that FineEdit outperforms state-of-the-art models, achieving improvements of approximately 10\% over Gemini models on single-turn edits, up to 30\% over Llama-3.2-3B, and exceeding Mistral-7B-OpenOrca performance by over 40\% on direct editing tasks. FineEdit also effectively generalizes to realistic multi-turn editing scenarios, highlighting its practical applicability. To facilitate further research and reproducibility, we release FineEdit at this https URL} and this https URL.
Submission history
From: Yiming Zeng Mr. [view email]
[v1] Wed, 19 Feb 2025 01:41:44 UTC (860 KB)
[v2] Tue, 20 May 2025 18:27:30 UTC (9,932 KB)
[v3] Tue, 26 Aug 2025 17:11:42 UTC (9,178 KB)
[v4] Wed, 15 Oct 2025 04:24:23 UTC (9,308 KB)
[v5] Mon, 26 Jan 2026 02:27:54 UTC (9,303 KB)