data-dedupe-array Edge Function — Data

data-dedupe-array — Remove duplicate items from an array

Deduplicates arrays using strict equality for primitives, deep equality for objects, or a key field for efficient object deduplication.

---

API

POST /api/data-dedupe-array

Request body

Field	Type	Required	Default	Description
items	unknown[]	✅	—	Array to deduplicate
key	string	❌	—	Field name to dedupe objects by (e.g. "id")

Success response (200)

{
  "success": true,
  "data": {
    "items": [1, 2, 3],
    "removedCount": 2
  }
}

Error responses

Code	HTTP	When
INVALID_INPUT	400	items is not an array
INTERNAL_ERROR	500	key provided but items contain non-objects

---

Usage

cURL

curl -X POST "$FUNCTION_URL" \
  -H "Content-Type: application/json" \
  -d '{"items": [{"id":1},{"id":2},{"id":1}], "key": "id"}'

TypeScript / JavaScript (HTTP)

const response = await fetch(FUNCTION_URL, {
  method: 'POST',
  headers: { 'Content-Type': 'application/json' },
  body: JSON.stringify({ items: users, key: 'email' }),
});
const { data } = await response.json();
console.log(data.items, `removed: ${data.removedCount}`);

Direct import (Node / Bun / Deno)

import { dedupeArray } from '@aerostack/functions/data-dedupe-array';

const { items, removedCount } = dedupeArray({ items: userList, key: 'userId' });

---

Use Cases

• Deduplicating user records merged from multiple data sources before database import
• Removing duplicate tag or category values from user-generated content
• Ensuring uniqueness of items in a workflow pipeline before passing to a downstream step

---

Notes

• First occurrence is always kept; subsequent duplicates are removed
• For objects without key: uses JSON.stringify deep equality — key order matters
• For primitives: uses strict value equality via JSON.stringify