Using ChatGPT to summarize a website through API

john.mock · 2024-10-31T17:18:46.481Z

Hi, I am working on a project where I would like to have chatGPT summarize any website for a URL entered by the user. I realize the chatGPT Completions API cannot browse the web so I’m not exactly sure of my next step. I thought maybe I could download the webpage and just upload the file to chatGPT for analysis, but I’m not seeing how to work with files with the Completion API.

Any help would be greatly appreciated!!

jupixy · 2024-10-31T17:43:29.253Z

Hi. Should be no problem.
Do you already have an existing API call to your chatgpt api?
Are you able to “send” a string via bubble.io/API to chatgpt and get a result to display in bubble?

john.mock · 2024-10-31T18:40:20.884Z

Yes, I have the api connector setup and I can send text to chatgpt and display replies in my Bubble app.

hi_bubble · 2024-10-31T22:49:41.718Z

I recommend to use DataForSEO’s endpoint AI Summary. Its super simple and has very good results.

I use it for the exact same reason.

john.mock · 2025-01-16T17:45:24.558Z

I wanted to leave an update in case anyone comes along and is curious how I resolved this issue. Initially, I tried downloading an entire web page and passing that to the chatGPT API. This had a bunch of problems including various characters in the code causing json issues.

Instead of downloading the entire page, I grabbed the page Title and Description. I then passed these both to the chatGPT API and had it summarize the site based on this info. It works surprisingly well so far!