-
Notifications
You must be signed in to change notification settings - Fork 103
Hint use agent #316
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Hint use agent #316
Changes from all commits
Commits
Show all changes
72 commits
Select commit
Hold shift + click to select a range
7af2d15
fixes
ollmer 3f9e4a2
add new deps
ollmer c88d7f3
use external embedding service in task hints retrieval
ollmer 74fc47f
gpt5 fixes
ollmer 1de1e51
first cut
amanjaiswal73892 2b4633a
update
amanjaiswal73892 380c69f
add event listeners and launcher
amanjaiswal73892 d3054cd
Add codegen step-wise recoder agent
amanjaiswal73892 ecb8f11
Merge branch 'trace-recorder' into hints_retrieve
ollmer 825effb
adding task hints to generic agent
hnekoeiq 5405029
Merge branch 'generic_agent_hinter' of github.com:ServiceNow/AgentLab…
hnekoeiq bf0b6e7
fix repeated llm configs
ollmer f7d1545
load env vars in codegen agent
ollmer 24a14f2
Merge branch 'generic_agent_hinter' into hints_retrieve
ollmer 55ce26a
same hints retrieval for both generic and tooluse agents
ollmer cad1209
filter out current task hints if needed
ollmer d920b8e
fix llm config, add gpt-5
ollmer 5315f14
fix
ollmer 26f0abb
pass new flag and fix db path passing issue
ollmer 5393a34
fix goal text
ollmer deddc50
fix current task hints exclusion
ollmer b9d09d4
remove old reqs
ollmer 725e7a0
remove recorder from that brach
ollmer e93fde5
log task errors
ollmer 5604ac3
expore agentlabxray
ollmer 0e68bca
remove commented old chunk
ollmer e4cad16
share xray only when env flag present
ollmer fcf42b3
Merge pull request #289 from ServiceNow/hints_retrieve
ollmer 94fa1ab
Add StepWiseQueriesPrompt for enhanced query handling in GenericAgent
recursix a43e54d
Merge branch 'main' into generic_agent_hinter
patricebechard 69048c4
update hinting agent retrieval
patricebechard ee2653a
stepwise hint retrieval
hnekoeiq abb897f
Merge branch 'generic_agent_hinter' into step-wise-retrieval
hnekoeiq ca11170
added shrink method
hnekoeiq dabddcf
Merge pull request #291 from ServiceNow/step-wise-retrieval
hnekoeiq c86873b
(wip) refactor hinting index
patricebechard 7e55cd7
(wip) clean up prompt file
patricebechard 66b9692
add scripts to run generic and hinter agents, update tmlr config for …
patricebechard d2166b3
move HintsSource to separate hinting file
patricebechard 60ad8e4
update hinter agent and prompt
patricebechard 4a2c7de
fix prompt for task hint
patricebechard eafd5fc
undo changes to tmlr config
patricebechard 70d701e
update hinter agent
patricebechard 91119d6
formatting
patricebechard a3b6ca4
bug fix hint retrieval
patricebechard 49ebc89
improve launch script
patricebechard ddea29b
get queries only for step level hint
hnekoeiq b38052e
Add webarenalite to agentlab loop.py
amanjaiswal73892 4189ca9
update stepwise hint queries prompt
ollmer 2e7de68
fix exc logging
ollmer 77fface
non empty instruction
ollmer bb15454
allow less then max hint queries
ollmer 04358c3
add generic agent gpt5-nano config
ollmer 0dcae12
make ray available on toolkit
ollmer 15c5639
check that hints db exists
ollmer 593e104
Merge branch 'generic_agent_hinter' into scratch/refactor-hint-retrieval
hnekoeiq ce866f6
Fix assignment of queries_for_hints variable
hnekoeiq 02dd9b8
Merge pull request #295 from ServiceNow/scratch/refactor-hint-retrieval
hnekoeiq 87e2510
Improve generic agent hinter (#309)
amanjaiswal73892 f06c6d0
add new flag to skip hints with the current goal in the hint source t…
amanjaiswal73892 cf0e9b3
Rename generic agent hinter to hint_use_agent (#311)
amanjaiswal73892 a46ddc6
bugfix: skip HintSource init if use_task_hint is false
amanjaiswal73892 04eddfe
Fix incorrect references for docs retrieval hinter agent (#313)
patricebechard 231175c
Add Environment Variable for Ray port (#315)
patricebechard 875ffd7
undo removed llm_config
amanjaiswal73892 c08fcf7
undo unnessary change
amanjaiswal73892 dd0d0cc
add missing default values for hint prompt flags
amanjaiswal73892 986969d
black
amanjaiswal73892 278ec93
Merge branch 'main' into hint-use-agent
amanjaiswal73892 07b97f4
update names in scripts
amanjaiswal73892 0571c89
use default prompt in hintSource for Tool Use agent
amanjaiswal73892 f3c22e1
remove experiment scripts
amanjaiswal73892 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| import importlib, sys, warnings | ||
|
|
||
| OLD = __name__ | ||
| NEW = "agentlab.agents.hint_use_agent" | ||
| SUBS = ("agent_configs", "generic_agent_prompt", "generic_agent", "tmlr_config") | ||
|
|
||
| warnings.warn( | ||
| f"{OLD} is renamed to {NEW}. {OLD} will be removed in future", | ||
| DeprecationWarning, | ||
| stacklevel=2, | ||
| ) | ||
|
|
||
| # Alias the top-level | ||
| new_mod = importlib.import_module(NEW) | ||
| sys.modules[OLD] = new_mod | ||
|
|
||
| # Alias known submodules | ||
| for sub in SUBS: | ||
| sys.modules[f"{OLD}.{sub}"] = importlib.import_module(f"{NEW}.{sub}") | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,54 @@ | ||
| """ | ||
| Baseline agent for all ServiceNow papers | ||
|
|
||
| This module contains the GenericAgent class, which is the baseline agent for all ServiceNow papers. \ | ||
| It is a simple agent that can be ran OOB on all BrowserGym environments. It is also shipped with \ | ||
| a few configurations that can be used to run it on different environments. | ||
| """ | ||
|
|
||
| from .agent_configs import ( | ||
| AGENT_3_5, | ||
| AGENT_8B, | ||
| AGENT_37_SONNET, | ||
| AGENT_CLAUDE_SONNET_35, | ||
| AGENT_CLAUDE_SONNET_35_VISION, | ||
| AGENT_CUSTOM, | ||
| AGENT_GPT5_MINI, | ||
| AGENT_GPT5_NANO, | ||
| AGENT_LLAMA3_70B, | ||
| AGENT_LLAMA4_17B_INSTRUCT, | ||
| AGENT_LLAMA31_70B, | ||
| CHAT_MODEL_ARGS_DICT, | ||
| RANDOM_SEARCH_AGENT, | ||
| AGENT_4o, | ||
| AGENT_4o_MINI, | ||
| AGENT_4o_MINI_VISION, | ||
| AGENT_4o_VISION, | ||
| AGENT_o1_MINI, | ||
| AGENT_o3_MINI, | ||
| FLAGS_GPT_4o, | ||
| GenericAgentArgs, | ||
| ) | ||
| from .generic_agent import GenericAgent, GenericAgentArgs | ||
|
|
||
| __all__ = [ | ||
| "AGENT_3_5", | ||
| "AGENT_4o", | ||
| "AGENT_4o_MINI", | ||
| "AGENT_4o_VISION", | ||
| "AGENT_o3_MINI", | ||
| "AGENT_o1_MINI", | ||
| "AGENT_LLAMA4_17B_INSTRUCT", | ||
| "AGENT_LLAMA3_70B", | ||
| "AGENT_LLAMA31_70B", | ||
| "AGENT_8B", | ||
| "RANDOM_SEARCH_AGENT", | ||
| "AGENT_CUSTOM", | ||
| "AGENT_CLAUDE_SONNET_35", | ||
| "AGENT_37_SONNET", | ||
| "AGENT_4o_VISION", | ||
| "AGENT_4o_MINI_VISION", | ||
| "AGENT_CLAUDE_SONNET_35_VISION", | ||
| "AGENT_GPT5_MINI", | ||
| "AGENT_GPT5_NANO", | ||
| ] |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@amanjaiswal73892 We can remove generic_agent_hinter files from this PR, no?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's a temporary alias of hint_use_agent for backward compatibility. Some existing pickled traces may still use the old namespace.