Deduplicate text and remove blank lines in the right order

Why duplicates can remain

Open the text tool (Chinese interface). Paste these five lines. The second line ends with a space and the third is empty. The deduplicate action treats Alpha and Alpha as different values.

Alpha
Alpha 

beta
BETA

Choose an intentional sequence

Select 去首尾空格 to trim each line, then 用结果继续处理 to reuse the output. Remove empty lines, reuse again, and deduplicate. The result is three lines: Alpha, beta and BETA. This sequence has been checked against the current implementation.

For case-insensitive matching, convert to lowercase, reuse and deduplicate again. You will get alpha and beta. Confirm that case is not meaningful in your identifiers before applying this transformation.

Read the counters correctly

The tool reports Unicode code points, non-whitespace code points, non-empty lines and UTF-8 bytes. The text 你好 👋\nA has 6 code points, 4 non-whitespace code points, 2 non-empty lines and 13 bytes. A displayed emoji can contain multiple code points. None of these counts is the model’s token count.

Chain operations carefully

An operation writes to the result area without replacing the original input. Reuse explicitly makes that result the next input. Inspect each intermediate step. When finished, copy the result or download a text file. Editing the input invalidates the previous output.

Use plain text, not structured spreadsheets

This tool is suitable for line-based lists and text cleanup. It is not a CSV or Excel parser: a quoted CSV field containing a newline requires structured parsing. Keep the original for comparison. Processing happens locally in the browser.