Skip to content

Commit b3f58a0

Browse files
committed
feat(seo): add blog post to llms.txt and allow AI crawlers in robots.txt
1 parent c115ffe commit b3f58a0

File tree

2 files changed

+32
-0
lines changed

2 files changed

+32
-0
lines changed

static/llms.txt

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,10 @@ OpenBoot automates your entire Mac dev environment — Homebrew packages, GUI ap
1010
- Website: https://openboot.dev
1111
- GitHub: https://github.com/openbootdotdev
1212

13+
## Blog
14+
15+
- [Mac Setup Automation Guide 2026](/blog/mac-setup-automation-guide-2026): Every way to automate a new Mac dev environment — Brewfile, shell scripts, chezmoi, nix-darwin, and OpenBoot compared. Includes 2026 tool recommendations, team onboarding, and quick-start recipes.
16+
1317
## Docs
1418

1519
- [What is OpenBoot](/docs/what-is-openboot): Open-source CLI that sets up your entire macOS dev environment — packages, apps, shell, dotfiles, and preferences — in one command.

static/robots.txt

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,4 +2,32 @@
22
User-agent: *
33
Disallow:
44

5+
# explicitly allow AI search crawlers
6+
User-agent: GPTBot
7+
Allow: /
8+
9+
User-agent: OAI-SearchBot
10+
Allow: /
11+
12+
User-agent: ChatGPT-User
13+
Allow: /
14+
15+
User-agent: ClaudeBot
16+
Allow: /
17+
18+
User-agent: Claude-Web
19+
Allow: /
20+
21+
User-agent: PerplexityBot
22+
Allow: /
23+
24+
User-agent: Google-Extended
25+
Allow: /
26+
27+
User-agent: Bytespider
28+
Allow: /
29+
30+
User-agent: cohere-ai
31+
Allow: /
32+
533
Sitemap: https://openboot.dev/sitemap.xml

0 commit comments

Comments
 (0)