Skip to content

fix: address PR review comments for Agent Sentinel (#5)#7

Open
a1k7 wants to merge 6 commits into
agentrust-io:mainfrom
a1k7:fix/review-fixes
Open

fix: address PR review comments for Agent Sentinel (#5)#7
a1k7 wants to merge 6 commits into
agentrust-io:mainfrom
a1k7:fix/review-fixes

Conversation

@a1k7

@a1k7 a1k7 commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

This PR addresses the review comments from #5:

  • ✅ Removed pycache files and added to .gitignore
  • ✅ Fixed duplicate imports in trace_claim_generator.py
  • ✅ Added real test stubs (not empty)
  • ✅ Populated docker-compose.yml and .trace-tests-config.yml
  • ✅ Fixed broken Markdown in README, removed absolute paths
  • ✅ Updated maintainer email in integration.yaml

Follow-up to #5.

@imran-siddique

akhil added 2 commits June 17, 2026 23:43
- Fix duplicate imports in trace_claim_generator.py
- Add real test stubs for detectors and integration
- Populate docker-compose.yml and .trace-tests-config.yml
- Fix broken Markdown in README, remove absolute paths
- Update maintainer email in integration.yaml
- Add __pycache__/ to .gitignore
- Remove tracked __pycache__ directories
@a1k7 a1k7 requested a review from imran-siddique as a code owner June 23, 2026 02:49
@github-actions

Copy link
Copy Markdown

🔴 Contributor Check: HIGH

Check Result
Profile HIGH
Credential NONE
Overall HIGH

Automated check by AGT Contributor Check.

@imran-siddique

Copy link
Copy Markdown
Contributor

Thanks @a1k7 - looks like we have some merge conflicts, can you resolve?

@a1k7

a1k7 commented Jun 23, 2026

Copy link
Copy Markdown
Contributor Author

@imran-siddique .Recheck whether conflicts are resolved or not?

@carloshvp

Copy link
Copy Markdown
Member

Small blocker: sentinel/src/trace_claim_generator.py still contains merge-conflict markers (<<<<<<< HEAD, =======, >>>>>>> upstream/main). That will make the module fail to import even though the repo validate workflow passes, since that workflow only validates integration manifests.

Could you resolve that block and run at least the Sentinel tests or a CLI import smoke test before this is reviewed again?

@a1k7

a1k7 commented Jun 25, 2026

Copy link
Copy Markdown
Contributor Author

@carloshvp I tried to resolve the conflicts . ready for re-review

@a1k7 a1k7 left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ready for re-review

@carloshvp

Copy link
Copy Markdown
Member

Thanks for resolving the conflict markers. I re-ran the Sentinel tests locally, since the repo validate workflow only checks integrations/*/integration.yaml and does not exercise the top-level sentinel/ code.

Current result:

PYTHONPATH=sentinel python -m pytest sentinel/tests -q

fails 3/4 tests:

  • test_delegation_escalation_detector* pass plain dicts, but DelegationEscalationDetector.detect() expects a SentinelInput.
  • the “clean” delegation test uses ["root", "admin"], but the detector currently treats root+admin as risky (0.7), so the test expectation does not match the implementation.
  • test_health_endpoint expects /health, but the FastAPI app currently has no /health route.

One structural note too: this integration still lives under top-level sentinel/, while the repo validator only scans integrations/*. So CI can pass without validating Sentinel’s manifest or code path. Could you either move this under integrations/sentinel/ with the current manifest schema, or clarify if top-level Sentinel is intentional and add a workflow that runs these tests?

@a1k7

a1k7 commented Jun 25, 2026

Copy link
Copy Markdown
Contributor Author

@carloshvp Ready for re-review

@carloshvp

Copy link
Copy Markdown
Member

Thanks for the update. I re-ran the review on the current head (039ef69).

Resolved:

  • No merge-conflict markers remain.
  • The focused Sentinel tests now pass:
    • PYTHONPATH=sentinel python3 -m pytest sentinel/tests -q -> 3 passed

There are still a few blockers before this is ready:

  1. Sentinel is still outside the validated integration layout. The repo workflow only scans integrations/*/integration.yaml, and a local run currently reports only nobulex:

    OK nobulex
    1 integration(s), 0 failure(s)

    So sentinel/integration.yaml and the Sentinel code are still invisible to CI. Please move this to integrations/sentinel/ or add an explicit workflow that validates/runs Sentinel.

  2. sentinel/integration.yaml does not match the current repo schema. Direct validation fails with:

    Additional properties are not allowed ('apiVersion', 'kind', 'metadata', 'spec' were unexpected)

    It should use the current manifest shape like name, vendor, integrates_with, description, maintainer, repository, license, and tier.

  3. The CLI path is still broken after the package move. The manifest/README/Dockerfile still reference src.*, but the code moved under sentinel.*:

    • PYTHONPATH=sentinel python3 -m src.cli sentinel/sample_trace.json --output /tmp/sentinel-report.json fails with No module named 'src'.
    • PYTHONPATH=sentinel python3 -m sentinel.cli sentinel/sample_trace.json --output /tmp/sentinel-report.json also fails because sentinel.trace_ingester still imports src.models and src.risk_engine.
    • Import smoke test also fails for sentinel.cli, sentinel.trace_ingester, and sentinel.risk_engine.
  4. There are still tracked generated files under sentinel/tests/__pycache__/. Please remove those from the PR.

Suggested next step: make the directory layout and manifest conform to the repo first, then run both the Sentinel tests and a CLI smoke test from the documented command path. Once those pass, this should be much easier to review.

@imran-siddique

Copy link
Copy Markdown
Contributor

Thanks @carloshvp for the thorough re-review, agreed on all four blockers. @a1k7 to set a clear bar before the next re-review request:

  1. Move the integration under integrations/sentinel/ so CI actually validates it (top-level sentinel/ is invisible to the integrations/* validator).
  2. Rewrite integration.yaml to the current manifest schema (name, vendor, integrates_with, description, maintainer, repository, license, tier), not apiVersion/kind/metadata/spec.
  3. Fix the package move fallout: nothing should import src.* anymore. Run a CLI smoke test from the documented command path before requesting review.
  4. Remove all tracked __pycache__/*.pyc files and confirm .gitignore covers them.

Please don't request re-review until validate lists Sentinel and both the tests and a CLI import smoke test pass locally. Happy to look again once it's conformant.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs-review:HIGH Contributor check flagged HIGH risk

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants