Add up-to-date Azure OpenAI Agents #284

patricebechard · 2025-08-27T16:57:34Z

This PR adds / updates azure openai agents with latest models (GPT-4o, GPT-4.1 and GPT-5).

Description by Korbit AI

What change is being made?

Add a comprehensive list of up-to-date Azure OpenAI agents, including configuration for various models like gpt-4o, gpt-4.1, and gpt-5 with their mini and nano versions, alongside adjustments to the implementation for Azure model API interactions.

Why are these changes being made?

These changes are being implemented to integrate the latest Azure OpenAI models into the existing system, ensuring that the system supports a broader range of models with vision capabilities and optimized configuration tokens. This also involves transitioning to a more streamlined API interaction approach by utilizing environment variable options more effectively.

Is this description stale? Ask me to generate a new description by commenting /korbit-generate-pr-description

korbit-ai

Review by Korbit AI

Korbit automatically attempts to detect when you fix issues in new commits.

Category	Issue	Status
	Unexplained API Version Hardcoding ▹ view
	Invalid Future Model Versions ▹ view
	Mismatched Model Flags ▹ view
	Inconsistent Token Limits for GPT-5 ▹ view	✅ Fix detected

Files scanned

File Path	Reviewed
src/agentlab/agents/generic_agent/init.py	✅
src/agentlab/agents/generic_agent/agent_configs.py	✅
src/agentlab/llm/llm_configs.py	✅
src/agentlab/llm/chat_api.py	✅

Explore our documentation to understand the languages and file types we support and the files we ignore.

Check out our docs on how you can make Korbit work best for you and your team.

Loving Korbit!? Share us on LinkedIn Reddit and X

src/agentlab/llm/llm_configs.py

+    "openai/gpt-5-2025-08-07": OpenAIModelArgs(
+        model_name="gpt-5-2025-08-07",
+        max_total_tokens=400_000,
+        max_input_tokens=272_000,
+        max_new_tokens=16_384,
+        temperature=1,  # gpt-5 supports temperature of 1 only
+        vision_support=True,
+    ),


korbit-ai · 2025-08-27T17:03:53Z

src/agentlab/agents/generic_agent/agent_configs.py

+AGENT_AZURE_4o_MINI = GenericAgentArgs(
+    chat_model_args=CHAT_MODEL_ARGS_DICT["azure/gpt-4o-mini-2024-07-18"],
+    flags=FLAGS_GPT_4o,
+)


Invalid Future Model Versions

Tell me more

What is the issue?

The Azure agents are created using future dates (2024-2025) in their model versions, which are not yet available and would cause runtime errors when attempting to use these models.

Why this matters

Using non-existent model versions will cause the application to fail when trying to make API calls to Azure OpenAI services.

Suggested change ∙ Feature Preview

Update the model versions to use currently available Azure OpenAI models. For example:

AGENT_AZURE_4o_MINI = GenericAgentArgs( chat_model_args=CHAT_MODEL_ARGS_DICT["azure/gpt-4-1106-preview"], flags=FLAGS_GPT_4o, )

Provide feedback to improve future suggestions

_{💬 Looking for more details? Reply to this comment to chat with Korbit.}

korbit-ai · 2025-08-27T17:03:53Z

src/agentlab/agents/generic_agent/agent_configs.py

+AGENT_AZURE_5 = GenericAgentArgs(
+    chat_model_args=CHAT_MODEL_ARGS_DICT["azure/gpt-5-2025-08-07"],
+    flags=FLAGS_GPT_4o,
+)


Mismatched Model Flags

Tell me more

What is the issue?

Using GPT-4 flags (FLAGS_GPT_4o) for GPT-5 models may not be appropriate as GPT-5 could have different capabilities and requirements.

Why this matters

Mismatched flags could lead to suboptimal performance or errors if GPT-5 has different token limits, capabilities, or API requirements compared to GPT-4.

Suggested change ∙ Feature Preview

Create specific flags for GPT-5 models that account for their unique capabilities:

FLAGS_GPT_5 = GenericPromptFlags( # GPT-5 specific configurations max_prompt_tokens=100_000, # Adjust based on actual GPT-5 limits # ... other GPT-5 specific settings ) AGENT_AZURE_5 = GenericAgentArgs( chat_model_args=CHAT_MODEL_ARGS_DICT["azure/gpt-5-2025-08-07"], flags=FLAGS_GPT_5, )

Provide feedback to improve future suggestions

_{💬 Looking for more details? Reply to this comment to chat with Korbit.}

korbit-ai · 2025-08-27T17:03:53Z

src/agentlab/llm/chat_api.py

        client_args = {
-            "azure_deployment": deployment_name,
-            "azure_endpoint": endpoint,
-            "api_version": "2024-02-01",
+            "base_url": endpoint,
+            "default_query": {"api-version": "preview"},
        }


Unexplained API Version Hardcoding

Tell me more

What is the issue?

The API version 'preview' is hardcoded without explanation of why this specific version is used or what features it enables.

Why this matters

Future developers may hesitate to update the API version without understanding its implications, potentially missing out on important features or bug fixes.

Suggested change ∙ Feature Preview

Add a constant at the module level with a comment explaining the choice:

# Latest stable version supporting vision features and updated token limits AZURE_API_VERSION = "preview" client_args = { "base_url": endpoint, "default_query": {"api-version": AZURE_API_VERSION}, }

Provide feedback to improve future suggestions

_{💬 Looking for more details? Reply to this comment to chat with Korbit.}

migration guide from Azure: https://learn.microsoft.com/en-us/azure/ai-foundry/openai/api-version-lifecycle?tabs=key#code-changes

Thanks for sharing the migration guide. That explains the use of "preview" for API version. Since it's documented in official Azure guidance, I'll withdraw my suggestion about adding explanatory comments.

recursix · 2025-08-27T17:03:29Z

src/agentlab/llm/llm_configs.py

        max_new_tokens=64_000,
        temperature=1e-1,
    ),
-    "openai/gpt-5-nano-2025-08-07": OpenAIModelArgs(


why deleting those?

This is a duplicate entry. The same key is already populated above.

recursix · 2025-08-27T17:04:24Z

src/agentlab/llm/chat_api.py

        self,
        model_name,
        api_key=None,
-        deployment_name=None,


deployment_name is no longer needed?

No, we switched from using the AzureOpenAI client to OpenAI as it allows us to remove one of the necessary env variables.

Here's the migration guide from Azure: https://learn.microsoft.com/en-us/azure/ai-foundry/openai/api-version-lifecycle?tabs=key#code-changes

patricebechard · 2025-08-27T17:13:00Z

Currently using token limits provided by Azure: https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/models?tabs=global-standard%2Cstandard-chat-completions#gpt-5

amanjaiswal73892

LGTM Thank you!

patricebechard added 2 commits August 27, 2025 12:32

add up to date azure openai models

11de47b

update llm configs for gpt-5

a257eee

patricebechard requested review from amanjaiswal73892 and recursix August 27, 2025 16:57

patricebechard self-assigned this Aug 27, 2025

korbit-ai bot reviewed Aug 27, 2025

View reviewed changes

recursix reviewed Aug 27, 2025

View reviewed changes

update token limits following Azure's documentation

b907f4c

amanjaiswal73892 approved these changes Aug 27, 2025

View reviewed changes

amanjaiswal73892 merged commit 0b1eb18 into main Aug 27, 2025
6 checks passed

amanjaiswal73892 deleted the scratch/azure_agents branch August 27, 2025 17:48

amanjaiswal73892 restored the scratch/azure_agents branch August 27, 2025 18:08

patricebechard deleted the scratch/azure_agents branch August 28, 2025 00:59

Add up-to-date Azure OpenAI Agents #284

Add up-to-date Azure OpenAI Agents #284

Uh oh!

Conversation

patricebechard commented Aug 27, 2025 • edited by korbit-ai bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description by Korbit AI

What change is being made?

Why are these changes being made?

Uh oh!

korbit-ai bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Review by Korbit AI

Korbit automatically attempts to detect when you fix issues in new commits.

Uh oh!

This comment was marked as resolved.

Uh oh!

korbit-ai bot Aug 27, 2025

Choose a reason for hiding this comment

Invalid Future Model Versions

What is the issue?

Why this matters

Suggested change ∙ Feature Preview

Provide feedback to improve future suggestions

Uh oh!

korbit-ai bot Aug 27, 2025

Choose a reason for hiding this comment

Mismatched Model Flags

What is the issue?

Why this matters

Suggested change ∙ Feature Preview

Provide feedback to improve future suggestions

Uh oh!

korbit-ai bot Aug 27, 2025

Choose a reason for hiding this comment

Unexplained API Version Hardcoding

What is the issue?

Why this matters

Suggested change ∙ Feature Preview

Provide feedback to improve future suggestions

Uh oh!

patricebechard Aug 27, 2025

Choose a reason for hiding this comment

Uh oh!

korbit-ai bot Aug 27, 2025

Choose a reason for hiding this comment

Uh oh!

recursix Aug 27, 2025

Choose a reason for hiding this comment

Uh oh!

patricebechard Aug 27, 2025

Choose a reason for hiding this comment

Uh oh!

recursix Aug 27, 2025

Choose a reason for hiding this comment

Uh oh!

patricebechard Aug 27, 2025

Choose a reason for hiding this comment

Uh oh!

patricebechard commented Aug 27, 2025

Uh oh!

amanjaiswal73892 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

patricebechard commented Aug 27, 2025 •

edited by korbit-ai bot

Loading

korbit-ai bot left a comment •

edited

Loading