Robots.txt in an app with multiple dev versions

Hi,

I notice that when I check the box “Customize robots.txt” in the SEO tab in the settings there is the already pre-made robot.txt that disallow the dev version.

The default is :

User-agent: *
Disallow: /version-test/

If I have multiple dev versions, should I add the other ones ? I found a little weird that is not done automatically.

Hi @vicente1 :wave:
Yes you have to add other dev versions like this

User-agent: *
Disallow: /version-staging/
Disallow: /version-test/
1 Like

This topic was automatically closed after 70 days. New replies are no longer allowed.