Add comprehensive LLM tool detection support (18 tools)#52878
Open
Add comprehensive LLM tool detection support (18 tools)#52878
Conversation
Co-authored-by: baronfel <573979+baronfel@users.noreply.github.com>
Co-authored-by: baronfel <573979+baronfel@users.noreply.github.com>
Copilot
AI
changed the title
[WIP] Add support for additional LLM tool detections
Add comprehensive LLM tool detection support (18 tools)
Feb 6, 2026
baronfel
approved these changes
Feb 6, 2026
Contributor
|
This PR has been labeled with
|
nagilson
approved these changes
Feb 6, 2026
Contributor
There was a problem hiding this comment.
Pull request overview
Expands dotnet CLI telemetry’s LLM environment detection to cover a broader set of AI/agent tools (18 total), aiming for parity with the referenced “am-i-ai” detection list.
Changes:
- Added a new detection rule type to match specific environment variable values case-insensitively (
EnvironmentVariableValueRule). - Expanded
LLMEnvironmentDetectorForTelemetryfrom a small set of tools to 18 tools, supporting multiple simultaneous detections (comma-separated). - Extended unit test coverage to include the new tools and some multi-tool combinations.
Reviewed changes
Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
| test/dotnet.Tests/TelemetryCommonPropertiesTests.cs | Adds test cases for the newly detected tools and multi-tool combinations. |
| src/Cli/dotnet/Telemetry/LLMEnvironmentDetectorForTelemetry.cs | Extends LLM tool detection rules from 5 to 18 tools and returns comma-separated results. |
| src/Cli/dotnet/Telemetry/EnvironmentDetectionRule.cs | Introduces EnvironmentVariableValueRule for case-insensitive value-based env var matching. |
Member
|
@copilot update the in-repo telemetry docs at https://github.com/dotnet/sdk/pull/documentation/project-docs/telemetry.md |
Co-authored-by: baronfel <573979+baronfel@users.noreply.github.com>
Contributor
Author
Updated the telemetry documentation with the complete list of 18 supported LLM tools. (4adfd2a) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Plan: Add More LLM Tool Detections
Based on the am-i-ai library (https://github.com/trieloff/am-i-ai), we need to add the following LLM tool detections:
CODEX_CLI,CODEX_SANDBOX)OR_APP_NAMEmatching "Aider")AMP_HOME)QWEN_CODE)DROID_CLI)OPENCODE_AI)ZED_ENVIRONMENT,ZED_TERM)KIMI_CLI)OR_APP_NAMEmatching "OpenHands")GOOSE_TERMINAL)CLINE_TASK_ID)ROO_CODE_TASK_ID)WINDSURF_SESSION)Summary
Successfully added detection support for 13 additional LLM tools, bringing the total from 5 to 18 supported tools. The implementation includes:
Original prompt
✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.