I have been live with my site for the last 6 months with no issues, but suddenly within the last 3 days, my WU’s have been blowing up. Have been averaging less than 4k WU’s per day but in the last three days it is nearly 30k and I keep getting spikes alerts. I signed up for Cloudflare but it isn’t catching anything. Also, I haven’t pushed out any new deploys in over 3 weeks. it is happening at random times but twice it was around 4am, and today between 3-5pm. we run a marketplace and it is doing heavy search queries, like 140k in minutes. I figure a bot or scraper that Cloudflare isn’t catching. Our daily traffic has stayed consistent over the last 2 months. I’m at a loss on what to do here.
1 Like
Have you reviewed the metrics charts to determine what is consuming the workload?
Some loop must have burst, check your logs.
I had the same problem. something was hitting my pages, but my google analytics didn’t show any hits.
It spun through hundreds of thousands of WU’s.
I don’t know if “someone” is hitting bubble pages to drive up WUs…
If anyone else has seen this, please try and track it.
UPDATE: Figured this one out. Went to our google search console and found crawl requests and discovered that over the last 5 days google crawled / indexed our site to the tune of 493k times as it learned our entire site. Google has been actively crawling Spot A Pup at scale, with thousands of crawl requests showing up in Search Console as it mapped out our content. It didn’t just touch the homepage or skim basic HTML headers, it crawled deeper into the site, following internal links and pulling in the real page content across our breed pages, state/province and city landing pages, search/listing pages, breeder profiles, and individual puppy listings. As soon as it showed that google eased off, our WU’s dropped like a rock.
1 Like
That sounds like a good problem to have had. Means your app is well structured for SEO, good work on that and uncovering the WU consumption.