How to Make Blog Post Crawlable?

I think that may be accurate, and all we should expect from an LLM…I mean, if I want AI to reference my site in query responses from user search/question, that is all is needed. If want AI to read the entire page from prompt with direct link to site, that requires LLM to have built in browser capabilities which I imagine means they can not do it for static HTML site or JS site currently.

Google of course will be first to implement that and as a company will be the ultimate winner of AI race…the others are just burning cash and admitting by revising upward their expected losses over next 10 year periods, while Google still has a business that is a cash printing press that can support indefinitely their AI R&D investments. No outside capital needed. They may even go as Apple has toward designing their own AI chips and get away from reliance on Nvidia.

1 Like

The problem with you guys scraping, is you’re likely using primative technology for scraping. These providers do not supply that great of a scraper to begin with.

I have been using Firecrawl for almost a year now and it has been nothing but exceptional for me.

Now, in order to get SEO content from your non-static pages, you have to inject that SEO data via server-side, but, to get AI to be able to scrape the content, that doesn’t require server-side injection. That’s ultimately just for the metadata itself. The data however, with Firecrawl, it loads the page fully, then scrapes the content for you in whatever format you want (I use markdown).

Firecrawl has an MCP server as well, in which you can connect with the AI service you’re utilizing easily.

Does Firecrawl make it so that some random person asking an AI chatbot like chat GPT a question in which my dynamic bubble page content is relevant, would enable chat GPT to read my entire page?

For me, I’m just concerned about discoverability like SEO. My hopes are AI will know my site relevant and reference and provide link if using my page dynamic content in the query reply. So focused on AIO, AI Overview Optimization or AEO, Ask Engine Optimization.

1 Like

No, Firecrawl doesn’t automatically make your Bubble page accessible to ChatGPT or other AI chatbots. Here’s how it actually works:

What Firecrawl Does:

  • It’s a tool that you would use to scrape and structure web content for your own AI applications

  • It doesn’t create some universal index that all AI chatbots can access

  • Think of it like a specialized web scraper that formats data for LLMs

I think what it really comes down to… Don’t index your Bubble site for SEO. It’s not worth the headache. Bubble is not built with SEO in mind, it’s built for creativity and tooling. Use another form of web framework for your content.

Here’s a website I built on Bubble then switched to a different framework for the home page: https://soundways.org.

You’ll notice it is very quick.

The output from AI:

Based on my search, SoundWays.org is a mobile shockwave and TECAR therapy service operating in Portland and the Pacific Northwest region. This aligns with the tech stack you built for them! Here's what I found:

Business Overview

SoundWays provides professional mobile healing services in Portland, Oregon, specializing in shockwave and TECAR therapy for pain relief and injury recovery Sound Ways. They position themselves as offering "revolutionary wellness therapies that address the root cause of pain" Sound Ways rather than just temporary relief.

Services Offered

Shockwave Therapy (ESWT/EPAT):

Delivers acoustic pressure waves to injured tissues, stimulating blood flow, tissue regeneration, and reducing pain Soundways

Effective for plantar fasciitis, Achilles tendinopathy, tennis/golfer's elbow, calcific shoulder tendinitis, shin splints, and knee pain Soundways

TECAR Therapy:

Uses radio-frequency electromagnetic energy for therapeutic deep heating, enhancing cellular metabolism and reducing inflammation Soundways

Commonly used for sports recovery, soft tissue injuries, neck/shoulder/back pain, and arthritis symptoms Soundways

Business Model

The mobile service aspect is key - their certified therapist arrives at gyms, events, or business locations with all equipment needed Sound Ways. They've streamlined the process with:

Online scheduling

Patient portal system

Personalized treatment plans

Follow-up care and progress tracking

Contact Info

Phone: 541-398-5587 or (971) 412-6272

Location: 4145 SW Watson, Beaverton, OR 97005

Hours: Mon-Sat 9:00am-8:00pm

The site emphasizes "Most patients see improvement after just 2-3 sessions" Sound Ways and markets to both individual patients and corporate/sports wellness programs. They've built a strong value proposition around convenience (mobile service), expertise, and addressing root causes rather than symptoms.

The tech stack you built appears to support their patient portal, online scheduling, and overall web presence - creating a modern, professional platform for what could otherwise be seen as just another physical therapy service. Nice work on positioning them as a tech-forward wellness solution!

SEO was my main reasoning for switching. With Bubble, it was able to get the title, and description, but the content was iffy. It needs to be 100% every time.

1 Like

I still don’t know what’s the best way to do this. Do you change your Bubble settings to app(dot)site(dot)com and put new cname records? Then just add new records for the other framework and everything works?

yes! that’s exactly what I do.

app.(sitename).com (bubble)
(sitename).com (content)

1 Like

I wonder what the best platform for “content” is that covers both product pages and blogs. I’ve seen Hubspot used for this. Maybe Framer? Ghost seems too specific since it’s more for blogs.

I agree with @GH5T Bubble does not seem dependable for SEO. I think tyhey should be 100% open about this and warn users before sighing up.

Bubble’s fine for the app part, not so much for SEO. I split the domain, Bubble on a subdomain, content on Astro. Two CNAMEs, done. Indexing issues disappeared and Lighthouse scores shot up. Quick explainer if you need context: The Top 7 Experts for Generative Engine Optimization (GEO) Services.