Skip to content

feat: add NGT (Agentforce Studio) parse surface @W-22904106@ #302

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
BunnyBlit wants to merge 1 commit into
base: main
Choose a base branch
from
Open

feat: add NGT (Agentforce Studio) parse surface @W-22904106@ #302

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions messages/agentTest.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,3 +41,23 @@ NGT conversationHistory on test case %s, input %s mixes turns with and without `
# ngtLooksLikeLegacySpec

This YAML looks like a legacy AiEvaluationDefinition spec (uses top-level `utterance:` / `expectedTopic:` / `customEvaluations:`). Use `--test-runner testing-center` for legacy authoring, or hand-edit the deployed XML for `<scorer scorerType="Custom">` blocks on NGT.

# ngtMalformedMetadataXml

Failed to parse AiTestingDefinition metadata XML: %s

# ngtWrongMetadataRoot

AiTestingDefinition metadata XML must have a top-level <%s> element.

# ngtUnknownScorerNoExpected

Unknown NGT scorer name '%s' has no <expectedValue> in the metadata. Cannot infer whether the scorer requires an expected value — add an <expectedValue> or use a known scorer.

# ambiguousTestDefinition

Both an AiEvaluationDefinition and an AiTestingDefinition exist for '%s' in the org. Disambiguate by passing a local metadata file path, or delete one of the metadata records.

# ngtSpecCannotProduceLegacyMetadata

This AgentTest holds an NGT (`NgtTestSpec`) spec but `getMetadata()` returns the legacy `AiEvaluationDefinition` shape. Use `convertToTestingMetadata` + `buildTestingMetadataXml` to serialize an NGT spec to its `AiTestingDefinition` XML.
Loading
Loading