Merge pull request 0xPolygon#2453 from 0xPolygon/platform/remove-robot-entries

Platform: Update sitemap and robots txt

Author: kmurphypolygon

docs/robots.txt

@@ -1,9 +1,4 @@
 User-agent: *
 Allow: /
-Disallow: /docs/
-Disallow: /tutorials/
-Disallow: /developer/
-Disallow: /core/
-Disallow: /validator/
 
 Sitemap: https://docs.polygon.technology/sitemap.xml