Skip to content
Accuracy Tests

chore(deps-dev): bump @ai-sdk/google from 2.0.40 to 2.0.44 (#791) #822

Sign in to view logs

chore(deps-dev): bump @ai-sdk/google from 2.0.40 to 2.0.44 (#791)

chore(deps-dev): bump @ai-sdk/google from 2.0.40 to 2.0.44 (#791) #822

Triggered via push December 10, 2025 16:27
@mongodb-devtools-botmongodb-devtools-bot[bot]
pushed 55ab647
main
Status Failure
Total duration 18m 2s
Artifacts 2

accuracy-tests.yml

on: push
Run Accuracy Tests
17m 56s
Run Accuracy Tests
Fit to window
Zoom out
Zoom in

Annotations

9 errors
Run Accuracy Tests
Process completed with exit code 1.
tests/accuracy/listCollections.test.ts > 'Azure - gpt-4o' > 'List all the collections that I have …': tests/accuracy/sdk/agent.ts#L69
AI_RetryError: Failed after 3 attempts. Last error: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease. ❯ _retryWithExponentialBackoff node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:111:13 ❯ fn node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34 ❯ node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22 ❯ generateText node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12 ❯ Object.prompt tests/accuracy/sdk/agent.ts:69:44 ❯ tests/accuracy/sdk/describeAccuracyTests.ts:124:28 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { reason: 'maxRetriesExceeded', errors: [ { stack: 'AI_APICallError: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 4 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/response-handler.ts:57:16\n at processTicksAndRejections (node:internal/process/task_queues:103:5)\n at postToApi (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:118:28)\n at OpenAIChatLanguageModel.doGenerate (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+openai@2.0.69_zod@3.25.76/node_modules/@ai-sdk/openai/src/chat/openai-chat-language-model.ts:322:9)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:389:32)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at _retryWithExponentialBackoff (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:96:12)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at generateText (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12)', message: 'Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 4 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.', name: 'AI_APICallError', cause: undefined, url: 'https://gai-405.openai.azure.com/openai//deployments/gpt-4o/chat/completions?api-version=2024-12-01-preview', requestBodyValues: { model: 'gpt-4o', logit_bias: undefined, logprobs: undefined, top_logprobs: undefined, user: undefined, parallel_tool_calls: undefined, max_tokens: undefined, temperature: undefined, top_p: undefined, frequency_penalty: undefined, presence_penalty: undefined, response_format: undefined, stop: undefined, seed: undefi
tests/accuracy/export.test.ts > 'Azure - gpt-4o' > 'Export an aggregation that groups all…': tests/accuracy/sdk/agent.ts#L69
AI_RetryError: Failed after 3 attempts. Last error: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease. ❯ _retryWithExponentialBackoff node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:111:13 ❯ fn node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34 ❯ node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22 ❯ generateText node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12 ❯ Object.prompt tests/accuracy/sdk/agent.ts:69:44 ❯ tests/accuracy/sdk/describeAccuracyTests.ts:124:28 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { reason: 'maxRetriesExceeded', errors: [ { stack: 'AI_APICallError: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 2 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/response-handler.ts:57:16\n at processTicksAndRejections (node:internal/process/task_queues:103:5)\n at postToApi (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:118:28)\n at OpenAIChatLanguageModel.doGenerate (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+openai@2.0.69_zod@3.25.76/node_modules/@ai-sdk/openai/src/chat/openai-chat-language-model.ts:322:9)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:389:32)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at _retryWithExponentialBackoff (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:96:12)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at generateText (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12)', message: 'Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 2 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.', name: 'AI_APICallError', cause: undefined, url: 'https://gai-405.openai.azure.com/openai//deployments/gpt-4o/chat/completions?api-version=2024-12-01-preview', requestBodyValues: { model: 'gpt-4o', logit_bias: undefined, logprobs: undefined, top_logprobs: undefined, user: undefined, parallel_tool_calls: undefined, max_tokens: undefined, temperature: undefined, top_p: undefined, frequency_penalty: undefined, presence_penalty: undefined, response_format: undefined, stop: undefined, seed: undefi
tests/accuracy/dropIndex.test.ts > 'Azure - gpt-4o' > 'Create a vector search index on \'mfl…': tests/accuracy/sdk/agent.ts#L69
AI_RetryError: Failed after 3 attempts. Last error: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 2 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease. ❯ _retryWithExponentialBackoff node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:111:13 ❯ fn node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34 ❯ node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22 ❯ generateText node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12 ❯ Object.prompt tests/accuracy/sdk/agent.ts:69:44 ❯ tests/accuracy/sdk/describeAccuracyTests.ts:124:28 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { reason: 'maxRetriesExceeded', errors: [ { stack: 'AI_APICallError: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/response-handler.ts:57:16\n at processTicksAndRejections (node:internal/process/task_queues:103:5)\n at postToApi (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:118:28)\n at OpenAIChatLanguageModel.doGenerate (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+openai@2.0.69_zod@3.25.76/node_modules/@ai-sdk/openai/src/chat/openai-chat-language-model.ts:322:9)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:389:32)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at _retryWithExponentialBackoff (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:96:12)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at generateText (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12)', message: 'Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.', name: 'AI_APICallError', cause: undefined, url: 'https://gai-405.openai.azure.com/openai//deployments/gpt-4o/chat/completions?api-version=2024-12-01-preview', requestBodyValues: { model: 'gpt-4o', logit_bias: undefined, logprobs: undefined, top_logprobs: undefined, user: undefined, parallel_tool_calls: undefined, max_tokens: undefined, temperature: undefined, top_p: undefined, frequency_penalty: undefined, presence_penalty: undefined, response_format: undefined, stop: undefined, seed: undefin
tests/accuracy/createCollection.test.ts > 'Azure - gpt-4o' > 'If and only if, the namespace \'mflix…': tests/accuracy/sdk/agent.ts#L69
AI_RetryError: Failed after 3 attempts. Last error: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease. ❯ _retryWithExponentialBackoff node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:111:13 ❯ fn node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34 ❯ node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22 ❯ generateText node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12 ❯ Object.prompt tests/accuracy/sdk/agent.ts:69:44 ❯ tests/accuracy/sdk/describeAccuracyTests.ts:124:28 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { reason: 'maxRetriesExceeded', errors: [ { stack: 'AI_APICallError: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 3 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/response-handler.ts:57:16\n at processTicksAndRejections (node:internal/process/task_queues:103:5)\n at postToApi (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:118:28)\n at OpenAIChatLanguageModel.doGenerate (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+openai@2.0.69_zod@3.25.76/node_modules/@ai-sdk/openai/src/chat/openai-chat-language-model.ts:322:9)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:389:32)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at _retryWithExponentialBackoff (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:96:12)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at generateText (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12)', message: 'Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 3 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.', name: 'AI_APICallError', cause: undefined, url: 'https://gai-405.openai.azure.com/openai//deployments/gpt-4o/chat/completions?api-version=2024-12-01-preview', requestBodyValues: { model: 'gpt-4o', logit_bias: undefined, logprobs: undefined, top_logprobs: undefined, user: undefined, parallel_tool_calls: undefined, max_tokens: undefined, temperature: undefined, top_p: undefined, frequency_penalty: undefined, presence_penalty: undefined, response_format: undefined, stop: undefined, seed: undefi
tests/accuracy/connectDeployment.test.ts > 'Azure - gpt-4o' > 'Connect to a new local MongoDB cluste…': tests/accuracy/sdk/agent.ts#L69
AI_RetryError: Failed after 3 attempts. Last error: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease. ❯ _retryWithExponentialBackoff node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:111:13 ❯ fn node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34 ❯ node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22 ❯ generateText node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12 ❯ Object.prompt tests/accuracy/sdk/agent.ts:69:44 ❯ tests/accuracy/sdk/describeAccuracyTests.ts:124:28 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { reason: 'maxRetriesExceeded', errors: [ { stack: 'AI_APICallError: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/response-handler.ts:57:16\n at processTicksAndRejections (node:internal/process/task_queues:103:5)\n at postToApi (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:118:28)\n at OpenAIChatLanguageModel.doGenerate (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+openai@2.0.69_zod@3.25.76/node_modules/@ai-sdk/openai/src/chat/openai-chat-language-model.ts:322:9)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:389:32)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at _retryWithExponentialBackoff (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:96:12)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at generateText (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12)', message: 'Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.', name: 'AI_APICallError', cause: undefined, url: 'https://gai-405.openai.azure.com/openai//deployments/gpt-4o/chat/completions?api-version=2024-12-01-preview', requestBodyValues: { model: 'gpt-4o', logit_bias: undefined, logprobs: undefined, top_logprobs: undefined, user: undefined, parallel_tool_calls: undefined, max_tokens: undefined, temperature: undefined, top_p: undefined, frequency_penalty: undefined, presence_penalty: undefined, response_format: undefined, stop: undefined, seed: undefine
tests/accuracy/collectionSchema.test.ts > 'Azure - gpt-4o' > 'Is there a title field in \'mflix.mov…': tests/accuracy/sdk/agent.ts#L69
AI_RetryError: Failed after 3 attempts. Last error: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease. ❯ _retryWithExponentialBackoff node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:111:13 ❯ fn node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34 ❯ node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22 ❯ generateText node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12 ❯ Object.prompt tests/accuracy/sdk/agent.ts:69:44 ❯ tests/accuracy/sdk/describeAccuracyTests.ts:124:28 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { reason: 'maxRetriesExceeded', errors: [ { stack: 'AI_APICallError: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 3 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/response-handler.ts:57:16\n at processTicksAndRejections (node:internal/process/task_queues:103:5)\n at postToApi (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:118:28)\n at OpenAIChatLanguageModel.doGenerate (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+openai@2.0.69_zod@3.25.76/node_modules/@ai-sdk/openai/src/chat/openai-chat-language-model.ts:322:9)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:389:32)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at _retryWithExponentialBackoff (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:96:12)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at generateText (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12)', message: 'Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 3 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.', name: 'AI_APICallError', cause: undefined, url: 'https://gai-405.openai.azure.com/openai//deployments/gpt-4o/chat/completions?api-version=2024-12-01-preview', requestBodyValues: { model: 'gpt-4o', logit_bias: undefined, logprobs: undefined, top_logprobs: undefined, user: undefined, parallel_tool_calls: undefined, max_tokens: undefined, temperature: undefined, top_p: undefined, frequency_penalty: undefined, presence_penalty: undefined, response_format: undefined, stop: undefined, seed: undefi
tests/accuracy/collectionIndexes.test.ts > 'Azure - gpt-4o' > 'which vector search indexes do I have…': tests/accuracy/sdk/agent.ts#L69
AI_RetryError: Failed after 3 attempts. Last error: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease. ❯ _retryWithExponentialBackoff node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:111:13 ❯ fn node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34 ❯ node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22 ❯ generateText node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12 ❯ Object.prompt tests/accuracy/sdk/agent.ts:69:44 ❯ tests/accuracy/sdk/describeAccuracyTests.ts:124:28 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { reason: 'maxRetriesExceeded', errors: [ { stack: 'AI_APICallError: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 4 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/response-handler.ts:57:16\n at processTicksAndRejections (node:internal/process/task_queues:103:5)\n at postToApi (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:118:28)\n at OpenAIChatLanguageModel.doGenerate (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+openai@2.0.69_zod@3.25.76/node_modules/@ai-sdk/openai/src/chat/openai-chat-language-model.ts:322:9)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:389:32)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at _retryWithExponentialBackoff (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:96:12)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at generateText (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12)', message: 'Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 4 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.', name: 'AI_APICallError', cause: undefined, url: 'https://gai-405.openai.azure.com/openai//deployments/gpt-4o/chat/completions?api-version=2024-12-01-preview', requestBodyValues: { model: 'gpt-4o', logit_bias: undefined, logprobs: undefined, top_logprobs: undefined, user: undefined, parallel_tool_calls: undefined, max_tokens: undefined, temperature: undefined, top_p: undefined, frequency_penalty: undefined, presence_penalty: undefined, response_format: undefined, stop: undefined, seed: undefi
tests/accuracy/collectionIndexes.test.ts > 'Azure - gpt-4o' > 'how many search indexes do I have in …': tests/accuracy/sdk/agent.ts#L69
AI_RetryError: Failed after 3 attempts. Last error: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 4 seconds. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease. ❯ _retryWithExponentialBackoff node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:111:13 ❯ fn node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34 ❯ node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22 ❯ generateText node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12 ❯ Object.prompt tests/accuracy/sdk/agent.ts:69:44 ❯ tests/accuracy/sdk/describeAccuracyTests.ts:124:28 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { reason: 'maxRetriesExceeded', errors: [ { stack: 'AI_APICallError: Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/response-handler.ts:57:16\n at processTicksAndRejections (node:internal/process/task_queues:103:5)\n at postToApi (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+provider-utils@3.0.17_zod@3.25.76/node_modules/@ai-sdk/provider-utils/src/post-to-api.ts:118:28)\n at OpenAIChatLanguageModel.doGenerate (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/@AI-SDK+openai@2.0.69_zod@3.25.76/node_modules/@ai-sdk/openai/src/chat/openai-chat-language-model.ts:322:9)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:389:32)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at _retryWithExponentialBackoff (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/util/retry-with-exponential-backoff.ts:96:12)\n at fn (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:345:34)\n at file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/telemetry/record-span.ts:18:22\n at generateText (file:///home/runner/work/mongodb-mcp-server/mongodb-mcp-server/node_modules/.pnpm/ai@5.0.98_zod@3.25.76/node_modules/ai/src/generate-text/generate-text.ts:281:12)', message: 'Your requests to gpt-4o for gpt-4o in South Central US have exceeded the token rate limit for your current OpenAI S0 pricing tier. This request was for ChatCompletions_Create under Azure OpenAI API version 2024-12-01-preview. Please retry after 1 second. To increase your default rate limit, visit: https://aka.ms/oai/quotaincrease.', name: 'AI_APICallError', cause: undefined, url: 'https://gai-405.openai.azure.com/openai//deployments/gpt-4o/chat/completions?api-version=2024-12-01-preview', requestBodyValues: { model: 'gpt-4o', logit_bias: undefined, logprobs: undefined, top_logprobs: undefined, user: undefined, parallel_tool_calls: undefined, max_tokens: undefined, temperature: undefined, top_p: undefined, frequency_penalty: undefined, presence_penalty: undefined, response_format: undefined, stop: undefined, seed: undefin

Artifacts

Produced during runtime
Name Size Digest
accuracy-test-summary
47.7 KB
sha256:832de18f5416fcf66fb3d580e47b031cab8f3a858097a2eabaeee1b0f66ffab1
run-accuracy-tests-permissions-b57fed43708f38785b81157d9b9a613c
140 Bytes
sha256:7dca25648cece26069f93c695626895e1b4d4a59064fcc54e1d85c4871cdb7dd