Remove duplicates from JSON

stoklasa.michal666 · 2024-08-15T08:07:27.512Z

Hi,

Hi could you please help me remove duplicates in custom JSON?

I have multiple tools which return me JSON´s im formating to text with same structure and then all adding to one state which looks like that:

{"text":"some duplicated text", "url":"https://somedomain.com", "search":"tavily"},
{"text":"some duplicated text", "url":"https://somedomain2.com","search":"bing"},...

(results from two tools)

Goal is that i need to somehow remove items, which has duplicated text value. In this case, i need to get only one item:

{“text”:“some duplicated text”, “url”:“https://somedomain.com”}

Do anybody know how to solve easily?

Thank you.

amer · 2024-08-15T09:48:24.362Z

Hi @stoklasa.michal666 . You can use java script code to solve your problem easily (toolbox plugin).

stoklasa.michal666 · 2024-08-15T11:07:24.646Z

Yes, but thats harder way i think.

I thought about create own JS plugin but there have to be an easier way.