Merge pull request 0xPolygon#1788 from 0xPolygon/platform/add-disallow

kmurphypolygon · web-flow · commit 26ea9141c040 · 2024-10-10T17:24:52.000+02:00
Platform: Add disallows
diff --git a/docs/robots.txt b/docs/robots.txt
@@ -1,4 +1,9 @@
 User-agent: *
 Allow: /
+Disallow: /docs/
+Disallow: /tutorials/
+Disallow: /developer/
+Disallow: /core/
+Disallow: /validator/
 
 Sitemap: https://docs.polygon.technology/sitemap.xml
