|
2 | 2 |
|
3 | 3 | Check whether user-agent is an AI bot |
4 | 4 |
|
5 | | -```csv |
| 5 | +```csv:no-line-numbers |
6 | 6 | # Current list of AI bots: |
7 | | -ai2bot, amazonbot, anthropic-ai, claude-web, claudebot, |
8 | | -applebot, applebot-extended, bytespider, ccbot, dataforseobot, |
9 | | -diffbot, googleother, googleother-image, googleother-video, |
10 | | -google-extended, imagesiftbot, petalbot, facebookbot, |
11 | | -meta-externalagent, gptbot, oai-searchbot, perplexitybot, |
12 | | -timpibot, velenpublicwebcrawler, omgili, omgilibot, |
13 | | -semrushbot-ocob, webzio-extended, youbot, scrapy |
| 7 | +ai2bot, amazonbot, anthropic-ai, claude-web, claude-searchbot, claudebot, |
| 8 | +applebot, applebot-extended, bytespider, cohere-training-data-crawler, |
| 9 | +ccbot, coveobot, dataforseobot, deepseekbot, diffbot, googleother, |
| 10 | +googleother-image, googleother-video, google-extended, imagesiftbot, |
| 11 | +petalbot, facebookbot, meta-externalagent, gptbot, oai-searchbot, |
| 12 | +perplexitybot, semrushbot-ocob, timpibot, velenpublicwebcrawler, |
| 13 | +omgili, omgilibot, webzio-extended, youbot, chatglm-spider, scrapy |
14 | 14 | ``` |
15 | 15 |
|
16 | 16 | ## Code Example |
|
0 commit comments