Skip to content

feat: AI transparency page — model + LLM + data-API inventory (#108)#128

Merged
William-Hill merged 2 commits into
mainfrom
feature/ai-transparency-page
May 3, 2026
Merged

feat: AI transparency page — model + LLM + data-API inventory (#108)#128
William-Hill merged 2 commits into
mainfrom
feature/ai-transparency-page

Conversation

@William-Hill
Copy link
Copy Markdown
Collaborator

Summary

Adds /ai-transparency listing every AI or AI-adjacent surface running in the dashboard, with: algorithm, inputs, training data (if any), where the inference runs, what data flows on invocation, and the retention policy. Closes #108.

What's inventoried

  • 6 homegrown ML models (XGBoost / Random Forest, all on-prem, no third-party data flow): retention, time-to-credential, credential type, gateway math, gateway English, low GPA.
  • 3 OpenAI gpt-4o-mini routes with explicit data-flow disclosures: prompt→SQL analyzer (app/api/analyze), query-result summarizer (app/api/query-summary), course-pairing explainer (app/api/courses/explain-pairing).
  • 1 rule-based NLQ fallback at lib/prompt-analyzer.ts (no LLM, no outbound flow).
  • 1 external data API at schools.syntex-ai.com — disclosed honestly, even though it's project-controlled, because it isn't on the institution's infrastructure.
  • 1 in-development entry for the SHAP narrator.

Discoveries that shaped the disclosures

Implementation notes

  • Content lives in codebenders-dashboard/content/ai-transparency.ts as a typed AISurface[]. Chose typed TSX over markdown because (a) the codebase convention (/methodology is the precedent) is structured TSX with content arrays, (b) typed entries enforce required disclosure fields at compile time — the failure mode of a transparency page is omission, and TS catches that, markdown can't.
  • Page is linked from nav-header.tsx (visible to all roles) and from a new "See also" section at the bottom of /methodology.
  • No new dependencies.

Test plan

  • npm run dev and navigate to /ai-transparency; verify all entries render
  • Click "AI Transparency" in the nav header from each route
  • Visit /methodology and follow the new cross-link
  • Confirm Deployed vs In development badges render correctly
  • Confirm Homegrown vs Third-party: <provider> badges render correctly
  • npm run lint passes
  • npx tsc --noEmit passes

Related

Deviations from acceptance criteria in #108

  • "Markdown-sourced for easy maintenance" → typed TS module instead. Reasoning above. Same maintainability win, no new dep, matches codebase, gives compile-time guarantees that markdown can't.
  • "Linked from the dashboard footer" → there is no global footer in the app. Linked from the nav header instead, plus from /methodology. Equivalent reachability.

William-Hill and others added 2 commits May 3, 2026 09:32
Adds /ai-transparency listing every AI or AI-adjacent surface running in the
dashboard with: algorithm, inputs, training data, where it runs, data flow on
invocation, retention policy.

Surfaces inventoried:
- 6 homegrown ML models (retention, time-to-credential, credential type,
  gateway math, gateway English, low GPA)
- 3 OpenAI gpt-4o-mini routes (prompt→SQL analyzer, query summarizer,
  course-pairing explainer)
- 1 rule-based NLQ fallback (no LLM, no outbound flow)
- 1 external data API at schools.syntex-ai.com
- 1 in-development entry for the SHAP narrator

Content lives in codebenders-dashboard/content/ai-transparency.ts as a typed
AISurface[] (not markdown — matches the codebase TSX-with-content-arrays
pattern used by /methodology and gives compile-time enforcement of required
disclosure fields).

Linked from nav-header (visible to all roles) and from /methodology.

Closes #108. Part of #124 (spring-convening-followup epic).
…itles

- Export AI_TRANSPARENCY_HREF, category order, groupAISurfacesByCategory from content
- Thinner page: explicit section titles (fix explainability heading), rowCount tilde handling
- Nav and methodology cross-link use shared href

Co-authored-by: Cursor <cursoragent@cursor.com>
@William-Hill William-Hill merged commit d00adbc into main May 3, 2026
2 checks passed
@William-Hill William-Hill deleted the feature/ai-transparency-page branch May 3, 2026 13:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: AI transparency page — model inventory, data flow, and provider disclosure

1 participant