Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
72 commits
Select commit Hold shift + click to select a range
7af2d15
fixes
ollmer Aug 13, 2025
3f9e4a2
add new deps
ollmer Aug 13, 2025
c88d7f3
use external embedding service in task hints retrieval
ollmer Aug 19, 2025
74fc47f
gpt5 fixes
ollmer Aug 19, 2025
1de1e51
first cut
amanjaiswal73892 Aug 20, 2025
2b4633a
update
amanjaiswal73892 Aug 20, 2025
380c69f
add event listeners and launcher
amanjaiswal73892 Aug 20, 2025
d3054cd
Add codegen step-wise recoder agent
amanjaiswal73892 Aug 21, 2025
ecb8f11
Merge branch 'trace-recorder' into hints_retrieve
ollmer Aug 22, 2025
825effb
adding task hints to generic agent
hnekoeiq Aug 28, 2025
5405029
Merge branch 'generic_agent_hinter' of github.com:ServiceNow/AgentLab…
hnekoeiq Aug 28, 2025
bf0b6e7
fix repeated llm configs
ollmer Aug 28, 2025
f7d1545
load env vars in codegen agent
ollmer Aug 28, 2025
24a14f2
Merge branch 'generic_agent_hinter' into hints_retrieve
ollmer Aug 28, 2025
55ce26a
same hints retrieval for both generic and tooluse agents
ollmer Aug 29, 2025
cad1209
filter out current task hints if needed
ollmer Sep 1, 2025
d920b8e
fix llm config, add gpt-5
ollmer Sep 1, 2025
5315f14
fix
ollmer Sep 1, 2025
26f0abb
pass new flag and fix db path passing issue
ollmer Sep 1, 2025
5393a34
fix goal text
ollmer Sep 1, 2025
deddc50
fix current task hints exclusion
ollmer Sep 1, 2025
b9d09d4
remove old reqs
ollmer Sep 2, 2025
725e7a0
remove recorder from that brach
ollmer Sep 2, 2025
e93fde5
log task errors
ollmer Sep 2, 2025
5604ac3
expore agentlabxray
ollmer Sep 2, 2025
0e68bca
remove commented old chunk
ollmer Sep 3, 2025
e4cad16
share xray only when env flag present
ollmer Sep 3, 2025
fcf42b3
Merge pull request #289 from ServiceNow/hints_retrieve
ollmer Sep 3, 2025
94fa1ab
Add StepWiseQueriesPrompt for enhanced query handling in GenericAgent
recursix Sep 4, 2025
a43e54d
Merge branch 'main' into generic_agent_hinter
patricebechard Sep 5, 2025
69048c4
update hinting agent retrieval
patricebechard Sep 8, 2025
ee2653a
stepwise hint retrieval
hnekoeiq Sep 8, 2025
abb897f
Merge branch 'generic_agent_hinter' into step-wise-retrieval
hnekoeiq Sep 8, 2025
ca11170
added shrink method
hnekoeiq Sep 9, 2025
dabddcf
Merge pull request #291 from ServiceNow/step-wise-retrieval
hnekoeiq Sep 9, 2025
c86873b
(wip) refactor hinting index
patricebechard Sep 9, 2025
7e55cd7
(wip) clean up prompt file
patricebechard Sep 9, 2025
66b9692
add scripts to run generic and hinter agents, update tmlr config for …
patricebechard Sep 10, 2025
d2166b3
move HintsSource to separate hinting file
patricebechard Sep 10, 2025
60ad8e4
update hinter agent and prompt
patricebechard Sep 10, 2025
4a2c7de
fix prompt for task hint
patricebechard Sep 10, 2025
eafd5fc
undo changes to tmlr config
patricebechard Sep 10, 2025
70d701e
update hinter agent
patricebechard Sep 11, 2025
91119d6
formatting
patricebechard Sep 11, 2025
a3b6ca4
bug fix hint retrieval
patricebechard Sep 12, 2025
49ebc89
improve launch script
patricebechard Sep 12, 2025
ddea29b
get queries only for step level hint
hnekoeiq Sep 17, 2025
b38052e
Add webarenalite to agentlab loop.py
amanjaiswal73892 Sep 17, 2025
4189ca9
update stepwise hint queries prompt
ollmer Sep 24, 2025
2e7de68
fix exc logging
ollmer Sep 24, 2025
77fface
non empty instruction
ollmer Sep 24, 2025
bb15454
allow less then max hint queries
ollmer Sep 24, 2025
04358c3
add generic agent gpt5-nano config
ollmer Sep 25, 2025
0dcae12
make ray available on toolkit
ollmer Sep 26, 2025
15c5639
check that hints db exists
ollmer Sep 30, 2025
593e104
Merge branch 'generic_agent_hinter' into scratch/refactor-hint-retrieval
hnekoeiq Oct 17, 2025
ce866f6
Fix assignment of queries_for_hints variable
hnekoeiq Oct 17, 2025
02dd9b8
Merge pull request #295 from ServiceNow/scratch/refactor-hint-retrieval
hnekoeiq Oct 17, 2025
87e2510
Improve generic agent hinter (#309)
amanjaiswal73892 Oct 20, 2025
f06c6d0
add new flag to skip hints with the current goal in the hint source t…
amanjaiswal73892 Oct 21, 2025
cf0e9b3
Rename generic agent hinter to hint_use_agent (#311)
amanjaiswal73892 Oct 27, 2025
a46ddc6
bugfix: skip HintSource init if use_task_hint is false
amanjaiswal73892 Oct 27, 2025
04eddfe
Fix incorrect references for docs retrieval hinter agent (#313)
patricebechard Nov 3, 2025
231175c
Add Environment Variable for Ray port (#315)
patricebechard Nov 5, 2025
875ffd7
undo removed llm_config
amanjaiswal73892 Nov 20, 2025
c08fcf7
undo unnessary change
amanjaiswal73892 Nov 20, 2025
dd0d0cc
add missing default values for hint prompt flags
amanjaiswal73892 Nov 20, 2025
986969d
black
amanjaiswal73892 Nov 20, 2025
278ec93
Merge branch 'main' into hint-use-agent
amanjaiswal73892 Nov 26, 2025
07b97f4
update names in scripts
amanjaiswal73892 Nov 26, 2025
0571c89
use default prompt in hintSource for Tool Use agent
amanjaiswal73892 Nov 26, 2025
f3c22e1
remove experiment scripts
amanjaiswal73892 Nov 26, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -278,13 +278,15 @@ dynamic benchmarks.

## Variables
Here's a list of relevant env. variables that are used by AgentLab:
- `OPEAI_API_KEY` which is used by default for OpenAI LLMs.
- `OPENAI_API_KEY` which is used by default for OpenAI LLMs.
- `AZURE_OPENAI_API_KEY`, used by default for AzureOpenAI LLMs.
- `AZURE_OPENAI_ENDPOINT` to specify your Azure endpoint.
- `OPENAI_API_VERSION` for the Azure API.
- `OPENROUTER_API_KEY` for the Openrouter API
- `AGENTLAB_EXP_ROOT`, desired path for your experiments to be stored, defaults to `~/agentlab-results`.
- `AGENTXRAY_SHARE_GRADIO`, which prompts AgentXRay to open a public tunnel on launch.
- `RAY_PUBLIC_DASHBOARD` (true / false), used to specify whether the ray dashboard should be made publicly accessible (`0.0.0.0`) or not (`127.0.0.1`).
- `RAY_DASHBOARD_PORT` (int), used to specify the port on which the ray dashboard should be accessible.

## Misc

Expand Down
19 changes: 19 additions & 0 deletions src/agentlab/agents/generic_agent_hinter/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
import importlib, sys, warnings

OLD = __name__
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@amanjaiswal73892 We can remove generic_agent_hinter files from this PR, no?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a temporary alias of hint_use_agent for backward compatibility. Some existing pickled traces may still use the old namespace.

NEW = "agentlab.agents.hint_use_agent"
SUBS = ("agent_configs", "generic_agent_prompt", "generic_agent", "tmlr_config")

warnings.warn(
f"{OLD} is renamed to {NEW}. {OLD} will be removed in future",
DeprecationWarning,
stacklevel=2,
)

# Alias the top-level
new_mod = importlib.import_module(NEW)
sys.modules[OLD] = new_mod

# Alias known submodules
for sub in SUBS:
sys.modules[f"{OLD}.{sub}"] = importlib.import_module(f"{NEW}.{sub}")
54 changes: 54 additions & 0 deletions src/agentlab/agents/hint_use_agent/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
"""
Baseline agent for all ServiceNow papers

This module contains the GenericAgent class, which is the baseline agent for all ServiceNow papers. \
It is a simple agent that can be ran OOB on all BrowserGym environments. It is also shipped with \
a few configurations that can be used to run it on different environments.
"""

from .agent_configs import (
AGENT_3_5,
AGENT_8B,
AGENT_37_SONNET,
AGENT_CLAUDE_SONNET_35,
AGENT_CLAUDE_SONNET_35_VISION,
AGENT_CUSTOM,
AGENT_GPT5_MINI,
AGENT_GPT5_NANO,
AGENT_LLAMA3_70B,
AGENT_LLAMA4_17B_INSTRUCT,
AGENT_LLAMA31_70B,
CHAT_MODEL_ARGS_DICT,
RANDOM_SEARCH_AGENT,
AGENT_4o,
AGENT_4o_MINI,
AGENT_4o_MINI_VISION,
AGENT_4o_VISION,
AGENT_o1_MINI,
AGENT_o3_MINI,
FLAGS_GPT_4o,
GenericAgentArgs,
)
from .generic_agent import GenericAgent, GenericAgentArgs

__all__ = [
"AGENT_3_5",
"AGENT_4o",
"AGENT_4o_MINI",
"AGENT_4o_VISION",
"AGENT_o3_MINI",
"AGENT_o1_MINI",
"AGENT_LLAMA4_17B_INSTRUCT",
"AGENT_LLAMA3_70B",
"AGENT_LLAMA31_70B",
"AGENT_8B",
"RANDOM_SEARCH_AGENT",
"AGENT_CUSTOM",
"AGENT_CLAUDE_SONNET_35",
"AGENT_37_SONNET",
"AGENT_4o_VISION",
"AGENT_4o_MINI_VISION",
"AGENT_CLAUDE_SONNET_35_VISION",
"AGENT_GPT5_MINI",
"AGENT_GPT5_NANO",
]
Loading
Loading