Remove Duplicate Words & Lines Full Text, Sentence & Line Scope
Remove duplicate words and lines across your full text, sentences, or line blocks.
Three Dedup Scopes
Full Text removes a word once it has appeared anywhere before. Per Sentence resets at each sentence boundary. Per Line treats every line independently.
Highlight View
Switch to Highlight mode to see exactly which words were removed — duplicates are struck through and faded red so you can review every change before copying.
All Languages
Unicode-aware tokenizer handles Arabic, English, Chinese, Japanese, Hebrew, Russian, and all other scripts. RTL/LTR toggle for correct reading direction.
Smart Options
Toggle case-insensitive matching, trim extra whitespace, and strip punctuation before deduplication — independently configurable for precise control over the output.
Duplicate Report
Every removed word appears as a chip with its total occurrence count. See which words were most overused at a glance — click any chip to copy it instantly.
Use as Input
Click "Use as Input" to push the cleaned output back into the editor for a second deduplication pass — great for iterative cleaning or chaining with other text tools.