Crawl stats - huge disproportion in JSON & HTML

Questions
1

Hi,

I am new at bubble and read few topic related to SEO but didn’t found questions similar to mine.
I see in crawl stats in Google Search Console a lot of requests to JSON files

image
image400×317 7.89 KB

I wonder if google really needs to access those files to grab content properly or I could just block those folders in robots.txt:
image
image808×479 27.4 KB

thanks in advance for help

2

Hey @whiner, I would recommend not blocking Googlebot (Google’s crawler) from blocking the resources mentioned in your screenshot. Those resources are critical for displaying the dynamic content for your bubble application. Blocking them via the robots.txt would basically prevent the crawler from being able to download the content full version of your bubble app (blocking those resources may also lead to weird issues in how the app would be presented). Generally there’s no reason to worry about these resources since they will not be placed into Google’s index.

As a primer on how crawling works and how it relates to your bubble app; I actually created a forum post here: https://forum.bubble.io/t/useful-bubble-seo-mental-models-a-guide-to-help-you-ultimately-rank-and-grok-seo-part-1/366067