Line Dedupe API

POST https://api.findutils.com/api/tools/line-dedupe/execute

Remove duplicate lines, keeping either the first or the last occurrence. Optionally case-insensitive, trim-aware, or inverted to show only the repeated lines.

Open the tool Try it

Request body

application/json

text

string required

Newline-separated input.
case_sensitive

boolean optional

Case-sensitive comparison. Defaults to true. Default true.
trim_lines

boolean optional

Trim each line before comparing. Defaults to true. Default true.
keep

string optional

Which occurrence of a repeated line to keep. Surviving lines stay in their original order either way. One of first · last. Default "first".
duplicates_only

boolean optional

Return only the lines that appear more than once, one copy each, instead of the deduplicated text. Default false.

Example arguments

Verified

{
  "text": "a\nb\na"
}

curl -X POST https://api.findutils.com/api/tools/line-dedupe/execute \
  -H "Content-Type: application/json" \
  -d '{
    "text": "a\nb\na"
  }'

const response = await fetch('https://api.findutils.com/api/tools/line-dedupe/execute', {
  method: 'POST',
  headers: { 'Content-Type': 'application/json' },
  body: JSON.stringify({"text":"a\nb\na"}),
});
const data = await response.json();

import requests

response = requests.post(
    "https://api.findutils.com/api/tools/line-dedupe/execute",
    json={"text":"a\nb\na"},
)
data = response.json()

$ch = curl_init('https://api.findutils.com/api/tools/line-dedupe/execute');
curl_setopt_array($ch, [
    CURLOPT_POST => true,
    CURLOPT_HTTPHEADER => ['Content-Type: application/json'],
    CURLOPT_POSTFIELDS => '{"text":"a\nb\na"}',
    CURLOPT_RETURNTRANSFER => true,
]);
$data = json_decode(curl_exec($ch), true);

Also an MCP tool

Call line_dedupe from Claude, Cursor or any MCP client. Same arguments, same output.

https://mcp.findutils.com

MCP reference

Rate limit: 60 a minute, per IP
Auth: None
REST id: line-dedupe
MCP name: line_dedupe
Category: Text
Machine-readable: openapi.json · markdown.md

Request body

Example arguments

More Text tools

More to explore