I am trying to grab the meta description from a user given URL and store it to a thing.
I’m currently doing this with ChatGPT, but I’m hoping there is a more correct/accurate way to go about this.
Thanks for help!
I am trying to grab the meta description from a user given URL and store it to a thing.
I’m currently doing this with ChatGPT, but I’m hoping there is a more correct/accurate way to go about this.
Thanks for help!
Try configuring an API request simply using GET and the URL. That might retrieve the page’s HTML, which you could then parse to extract the specifics you want.
Try some of your URLs on the service page of this plugin and check it extracts what you are expecting.
https://bubble.io/plugin/broken-url-and-image-checker-1618970342021x217683054542979070
The reason I suggest try some URLs out on it is if you are trying to screen scrape pages that don’t want to be screen scraped eg Airbnb listings, other proprietary content then there may be website content protection measures in place to stop this working.
This did the trick.
I was able to bring in the page HTML with the GET command and then isolate the meta content using a combo of extract with regex and then find and replace to clean it up.
Thanks!