Skip to content

Conversation

@patricebechard
Copy link
Collaborator

@patricebechard patricebechard commented Nov 5, 2025

No description provided.

@patricebechard patricebechard changed the base branch from main to generic_agent_hinter November 5, 2025 18:49
@korbit-ai
Copy link

korbit-ai bot commented Nov 5, 2025

I was unable to write a description for this pull request. This could be because I only found files I can't scan.

@korbit-ai
Copy link

korbit-ai bot commented Nov 5, 2025

Review by Korbit AI

Korbit automatically attempts to detect when you fix issues in new commits.
Category Issue Status
Logging Study log levels set too high ▹ view
Performance Inefficient DataFrame iteration with iterrows() ▹ view
Performance Inefficient list membership checks ▹ view
Performance Redundant data structure operations ▹ view
Performance Non-vectorized DataFrame string operations ▹ view
Design Hard-coded Configuration ▹ view
Logging Root logger level set too high ▹ view
Files scanned
File Path Reviewed
experiments/generic/run_generic_agent.sh
src/agentlab/agents/generic_agent_hinter/init.py
experiments/hinter/run_hinter_agent.sh
src/agentlab/agents/hint_use_agent/init.py
experiments/generic/run_generic_agent.py
src/agentlab/agents/hint_use_agent/tmlr_config.py
src/agentlab/experiments/graph_execution_ray.py
experiments/hinter/run_hinter_agent.py
src/agentlab/agents/generic_agent/generic_agent.py
src/agentlab/experiments/launch_exp.py
src/agentlab/llm/llm_configs.py
src/agentlab/utils/hinting.py
src/agentlab/agents/hint_use_agent/agent_configs.py
src/agentlab/agents/hint_use_agent/generic_agent_prompt.py
src/agentlab/agents/hint_use_agent/generic_agent.py
src/agentlab/agents/tool_use_agent/tool_use_agent.py
src/agentlab/experiments/loop.py
src/agentlab/analyze/agent_xray.py

Explore our documentation to understand the languages and file types we support and the files we ignore.

Check out our docs on how you can make Korbit work best for you and your team.

Loving Korbit!? Share us on LinkedIn Reddit and X

Comment on lines 11 to +12
RAY_PUBLIC_DASHBOARD = os.environ.get("RAY_PUBLIC_DASHBOARD", "false") == "true"
RAY_DASHBOARD_PORT = os.environ.get("RAY_DASHBOARD_PORT")
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hard-coded Configuration category Design

Tell me more
What is the issue?

Configuration values are defined at module level and directly dependent on environment variables, making the code less flexible and harder to test.

Why this matters

Hard-coded configuration reduces reusability and makes testing more difficult as it requires environment manipulation.

Suggested change ∙ Feature Preview

Move configuration to a dedicated config class or function:

def get_ray_config(config_dict=None):
    config = config_dict or {}
    return {
        'dashboard_public': config.get('RAY_PUBLIC_DASHBOARD', os.environ.get('RAY_PUBLIC_DASHBOARD', 'false') == 'true'),
        'dashboard_port': config.get('RAY_DASHBOARD_PORT', os.environ.get('RAY_DASHBOARD_PORT'))
    }
Provide feedback to improve future suggestions

Nice Catch Incorrect Not in Scope Not in coding standard Other

💬 Looking for more details? Reply to this comment to chat with Korbit.

Copy link
Collaborator

@amanjaiswal73892 amanjaiswal73892 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! It will be useful to document these variables in the readme along with the other variables.

@amanjaiswal73892 amanjaiswal73892 merged commit 231175c into generic_agent_hinter Nov 5, 2025
6 checks passed
@amanjaiswal73892 amanjaiswal73892 deleted the scratch/add-env-variable-for-ray-port branch November 5, 2025 19:51
@korbit-ai
Copy link

korbit-ai bot commented Nov 5, 2025

I was unable to write a description for this pull request. This could be because I only found files I can't scan.

amanjaiswal73892 added a commit that referenced this pull request Nov 27, 2025
* fixes

* add new deps

* use external embedding service in task hints retrieval

* gpt5 fixes

* first cut

* update

* add event listeners and launcher

* Add codegen step-wise recoder agent

* adding task hints to generic agent

* fix repeated llm configs

* load env vars in codegen agent

* same hints retrieval for both generic and tooluse agents

* filter out current task hints if needed

* fix llm config, add gpt-5

* fix

* pass new flag and fix db path passing issue

* fix goal text

* fix current task hints exclusion

* remove old reqs

* remove recorder from that brach

* log task errors

* expore agentlabxray

* remove commented old chunk

* share xray only when env flag present

* Add StepWiseQueriesPrompt for enhanced query handling in GenericAgent

* update hinting agent retrieval

* stepwise hint retrieval

* added shrink method

* (wip) refactor hinting index

* (wip) clean up prompt file

* add scripts to run generic and hinter agents, update tmlr config for hinter

* move HintsSource to separate hinting file

* update hinter agent and prompt

* fix prompt for task hint

* undo changes to tmlr config

* update hinter agent

* formatting

* bug fix hint retrieval

* improve launch script

* get queries only for step level hint

* Add webarenalite to agentlab loop.py

* update stepwise hint queries prompt

* fix exc logging

* non empty instruction

* allow less then max hint queries

* add generic agent gpt5-nano config

* make ray available on toolkit

* check that hints db exists

* Fix assignment of queries_for_hints variable

* Improve generic agent hinter (#309)

* Make LLM retreival topic index selection more robust

* add new flag to skip hints with the current goal in the hint source t… (#310)

* add new flag to skip hints with the current goal in the hint source traces

* Rename generic agent hinter to hint_use_agent (#311)

* rename generic_agent_hinter to hint_use_agent for clarity

* Add deprecation warning and module alias for generic_agent_hinter

* improve module aliasing for submodules

* Add todo rename agent name

* black

* bugfix: check for hint_db only when use_task_hint is true.

* fix: address missing initialization and correct args reference in choose_hints method

* black

* bugfix: skip HintSource init if use_task_hint is false

* Fix incorrect references for docs retrieval hinter agent (#313)

* address comments

* format

* Add Environment Variable for Ray port (#315)

* add env variable for ray port

* document env variables

* undo removed llm_config

* undo unnessary change

* add missing default values for hint prompt flags

* black

* update names in scripts

* use default prompt in hintSource for Tool Use agent

* remove experiment scripts

---------

Co-authored-by: Oleh Shliazhko <oleh.shliazhko@servicenow.com>
Co-authored-by: Hadi Nekoei <had.nekoeiqachkanloo@servicenow.com>
Co-authored-by: Oleh Shliazhko <ollmer@users.noreply.github.com>
Co-authored-by: recursix <alex.lacoste.shmu@gmail.com>
Co-authored-by: Patrice Bechard <patrice.bechard@servicenow.com>
Co-authored-by: Hadi Nekoei <hadinekoei94@gmail.com>
Co-authored-by: Patrice Bechard <bechardpatrice@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants