Skip to content

Commit 97465e4

Browse files
committed
Update to latest changes
1 parent 225bec6 commit 97465e4

File tree

6 files changed

+26
-8
lines changed

6 files changed

+26
-8
lines changed

docs/api/submodules/extensions/crawlers.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -28,13 +28,19 @@ Bots that automatically visit websites and collect data.
2828
- `ClaudeBot`
2929
- `coccocbot-web`
3030
- `coccocbot-image`
31+
- `cohere-training-data-crawler`
32+
- `Coveobot`
33+
- `CriteoBot`
3134
- `DataForSeoBot`
3235
- `Daum`
3336
- `Daumoa`
3437
- `Daumoa-image`
38+
- `DeepSeekBot`
3539
- `Diffbot`
3640
- `Dotbot`
3741
- `DuckDuckBot`
42+
- `DuckDuckGo-Favicons-Bot`
43+
- `Elastic`
3844
- `Exabot`
3945
- `FacebookBot`
4046
- `facebookexternalhit`

docs/api/submodules/extensions/fetchers.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,20 +3,27 @@
33
Bots that retrieve content from <u>**specific**</u> URLs <u>**on demand**</u>
44

55
- `AhrefsSiteAudit`
6+
- `Asana`
67
- `BingPreview`
8+
- `bitlybot`
79
- `Better Uptime Bot`
10+
- `Blueno`
811
- `Bluesky`
12+
- `BufferLinkPreviewBot`
913
- `ChatGPT-User`
14+
- `Chrome-Lighthouse`
1015
- `cohere-ai`
1116
- `Discordbot`
1217
- `DuckAssistBot`
1318
- `FeedFetcher-Google`
19+
- `Gemini-Deep-Research`
1420
- `Google-PageRenderer`
1521
- `Google-Read-Aloud`
1622
- `Google-Site-Verification`
1723
- `GoogleImageProxy`
1824
- `GoogleProducer`
1925
- `Iframely`
26+
- `kakaotalk-scrap`
2027
- `LinkedInBot`
2128
- `Mastodon`
2229
- `meta-externalfetcher`
@@ -34,6 +41,7 @@ Bots that retrieve content from <u>**specific**</u> URLs <u>**on demand**</u>
3441
- `Snap URL Preview`
3542
- `Snapchat`
3643
- `Telegrambot`
44+
- `TikTokSpider`
3745
- `Twitterbot`
3846
- `Uptimerobot`
3947
- `Vercelbot`
@@ -45,6 +53,7 @@ Bots that retrieve content from <u>**specific**</u> URLs <u>**on demand**</u>
4553
- `YandexSearchShop`
4654
- `YandexSitelinks`
4755
- `YandexUserProxy`
56+
- `Zoombot`
4857
- ... etc.
4958

5059
## Code Example

docs/api/submodules/helpers/is-ai-bot.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,15 @@
22

33
Check whether user-agent is an AI bot
44

5-
```csv
5+
```csv:no-line-numbers
66
# Current list of AI bots:
7-
ai2bot, amazonbot, anthropic-ai, claude-web, claudebot,
8-
applebot, applebot-extended, bytespider, ccbot, dataforseobot,
9-
diffbot, googleother, googleother-image, googleother-video,
10-
google-extended, imagesiftbot, petalbot, facebookbot,
11-
meta-externalagent, gptbot, oai-searchbot, perplexitybot,
12-
timpibot, velenpublicwebcrawler, omgili, omgilibot,
13-
semrushbot-ocob, webzio-extended, youbot, scrapy
7+
ai2bot, amazonbot, anthropic-ai, claude-web, claude-searchbot, claudebot,
8+
applebot, applebot-extended, bytespider, cohere-training-data-crawler,
9+
ccbot, coveobot, dataforseobot, deepseekbot, diffbot, googleother,
10+
googleother-image, googleother-video, google-extended, imagesiftbot,
11+
petalbot, facebookbot, meta-externalagent, gptbot, oai-searchbot,
12+
perplexitybot, semrushbot-ocob, timpibot, velenpublicwebcrawler,
13+
omgili, omgilibot, webzio-extended, youbot, chatglm-spider, scrapy
1414
```
1515

1616
## Code Example

docs/info/browser/name.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -152,4 +152,5 @@ Here is a list of possible values for `browser.name`:
152152
- [`Whale`](./name/whale.md)
153153
- [`Wolvic`](./name/wolvic.md)
154154
- [`Yandex`](./name/yandex.md)
155+
- `Zalo`
155156
- `...`

docs/info/cpu/arch.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,7 @@ Here is a list of possible values for `cpu.architecture`:
77
| `ia32` | Intel x86 |
88
| `amd64` | Intel x86-64 / x64 |
99
| `ia64` | Intel Itanium |
10+
| `alpha` | DEC Alpha |
1011
| `arm` | ARM 32-bit |
1112
| `arm64` | ARM 64-bit |
1213
| `armhf` | ARM Hard Float |

docs/info/device/vendor.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -50,6 +50,7 @@ Here is a list of possible values for `device.vendor`:
5050
- `Palm`
5151
- `Panasonic`
5252
- `Pebble`
53+
- `Philips`
5354
- `Pico`
5455
- `Polytron`
5556
- `Realme`

0 commit comments

Comments
 (0)