Skip to content

feat(git): Add Claude as a TextGenerationProvider#1323

Open
keyzou wants to merge 13 commits intopingdotgg:mainfrom
keyzou:feat/claude-text-generation
Open

feat(git): Add Claude as a TextGenerationProvider#1323
keyzou wants to merge 13 commits intopingdotgg:mainfrom
keyzou:feat/claude-text-generation

Conversation

@keyzou
Copy link

@keyzou keyzou commented Mar 23, 2026

What Changed

  • Added Claude as an alternate provider for git operations
  • Added a dropdown in the settings to choose a provider for Git operations.
  • Default provider is Claude Haiku 4.5 (changeable), reasoning low (unchangeable)
  • Tried to keep the feature parity with Codex for git operations, hope I didn't miss anything

I suggest reviewing commit-by-commit :)

I'm also not too familiar with Effect, so there might be some AI slop here and there, don't hesitate to flag it

⚠️ I'm also proposing an optional last commit (c6c833e) to refactor both providers to extract the prompt building logic into shared utilities. This is fairly opinionated, and we should probably discuss this, so I'm totally down to just drop that commit; we might want to tweak the prompts for a specific provider in the future

⚠️ I also couldn't test for regression on the Codex side, so I'll ask for one of you to make sure this all works correctly (tests are passing, I added a few for Claude, but maybe some bug went through, especially with the refactor)

I saw a similar PR at #1222 but since the change was not enough, I wanted to take a stab at the issue myself (not sure about the proper open-source etiquette here though)

Fixes #1221

Why

Pretty straightforward: I don't have Codex, so Git-related operations couldn't work for me :)

UI Changes

Here's the setting page with the Git section using Claude:

Enregistrement.de.l.ecran.2026-03-24.a.09.03.52.mov

Here's a demo of the branch name generation working (not sure I have the right flow) -- old model picker, see the video above for the updated version ^:

Enregistrement.de.l.ecran.2026-03-23.a.02.17.41.mp4

And here's a demo of committing and pushing (thus generating a commit message) -- old model picker, see the video above for the updated version:

Enregistrement.de.l.ecran.2026-03-23.a.02.15.14.mp4

Checklist

  • This PR is small and focused (not that small actually)
  • I explained what changed and why
  • I included before/after screenshots for any UI changes
  • I included a video for animation/interaction changes

Note

Add Claude as a text generation provider alongside Codex for git commit, PR, and branch name generation

  • Introduces a new ClaudeTextGeneration layer in ClaudeTextGeneration.ts that invokes the local claude CLI with structured JSON output and a 180s timeout.
  • Adds a RoutingTextGeneration layer that dispatches to Codex or Claude based on the provider field in each request; replaces the hardwired CodexTextGenerationLive in serverLayers.ts.
  • Extracts shared prompt builders and utilities into textGenerationPrompts.ts and textGenerationUtils.ts; CodexTextGeneration is refactored to use these.
  • Adds a textGenerationProvider setting ("codex" | "claudeAgent", default "codex") to app settings and a provider+model picker in the settings UI.
  • The GitRunStackedActionInput contract gains an optional textGenerationProvider field; per-provider default models are exposed via DEFAULT_GIT_TEXT_GENERATION_MODEL_BY_PROVIDER.
  • Behavioral Change: the server now uses RoutingTextGenerationLive instead of CodexTextGenerationLive, so any misconfigured provider field will fall back to Codex rather than erroring.

Macroscope summarized 20a38c2.


Note

Medium Risk
Adds a new CLI-backed text generation backend and routes git-generated content through a new provider-selection path, which can affect commit/PR/branch generation behavior and introduces new process-spawning/error-handling paths. Risk is moderated by defaulting to Codex when unspecified and by schema validation plus added unit tests for shared prompt/error utilities.

Overview
Adds a Claude-based git text generation provider that shells out to the claude CLI with JSON structured output, schema validation, and timeouts, alongside the existing Codex implementation.

Introduces provider selection end-to-end: TextGeneration inputs now accept provider ("codex" | "claudeAgent"), a new RoutingTextGenerationLive dispatches per-request to Codex vs Claude, and GitManager/RPC (GitRunStackedActionInput) forward the chosen provider through commit/branch/PR generation.

Refactors Codex/Claude to share prompt construction and common utilities (textGenerationPrompts.ts, textGenerationUtils.ts) and replaces the single default git model with per-provider defaults via DEFAULT_GIT_TEXT_GENERATION_MODEL_BY_PROVIDER. The web app adds a textGenerationProvider setting and updates the settings UI + git action mutation payload to send provider/model separately.

Written by Cursor Bugbot for commit 20a38c2. This will update automatically on new commits. Configure here.

@coderabbitai
Copy link

coderabbitai bot commented Mar 23, 2026

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Repository UI

Review profile: CHILL

Plan: Pro

Run ID: 576465b1-82eb-447a-b8c6-f0849843d741

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@github-actions github-actions bot added size:XXL 1,000+ changed lines (additions + deletions). vouch:unvouched PR author is not yet trusted in the VOUCHED list. labels Mar 23, 2026
@juliusmarminge
Copy link
Member

can we reuse the model picker from the chat UI? So it's a single select with provider top level, model submenu?

@keyzou
Copy link
Author

keyzou commented Mar 23, 2026

yep, didn't think about that, what do you think ? (updated the screenshot in the PR aswell)

Enregistrement.de.l.ecran.2026-03-23.a.19.37.28.mov

@juliusmarminge
Copy link
Member

looks good. resolve conflicts pls

@keyzou keyzou force-pushed the feat/claude-text-generation branch from c9d1242 to 66463d1 Compare March 24, 2026 08:02
@github-actions github-actions bot added size:XL 500-999 changed lines (additions + deletions). and removed size:XXL 1,000+ changed lines (additions + deletions). labels Mar 24, 2026
@keyzou
Copy link
Author

keyzou commented Mar 24, 2026

done, rebased on main (updated the video to reflect the recent UI changes on main)

return {
branch: sanitizeBranchFragment(generated.branch),
} satisfies BranchNameGenerationResult;
});
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude branch name generation silently drops image attachments

Medium Severity

The Claude generateBranchName implementation doesn't materialize or pass image attachments to the CLI, unlike the Codex implementation which calls materializeImageAttachments and passes imagePaths via --image flags. The prompt still tells the model to "use images as primary context for visual/UI issues," but the actual image files are never sent — only textual metadata about them is included. This means branch name generation with image attachments produces worse results on Claude compared to Codex.

Additional Locations (1)
Fix in Cursor Fix in Web

Copy link
Author

@keyzou keyzou Mar 24, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe out of scope for this PR ? Do we have cases where we infer the branch name / commit messages from images ?

"--effort",
CLAUDE_REASONING_EFFORT,
"--dangerously-skip-permissions",
],
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude CLI JSON schema may break on Windows

Medium Severity

The Claude CLI receives the JSON schema as an inline command-line argument via --json-schema jsonSchemaStr, while on Windows shell is set to true. The JSON string contains double quotes and braces that cmd.exe may interpret or mangle. The Codex implementation avoids this by writing the schema to a temp file and passing the file path instead.

Fix in Cursor Fix in Web

Copy link
Author

@keyzou keyzou Mar 24, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this can be dismissed: the schema should always be simple enough to never cause issues (for now), there should never be any special character outside the quotes and braces from the json in this case? which should already be properly handled by cmd.exe

@keyzou keyzou force-pushed the feat/claude-text-generation branch from dbe7e77 to cb76bce Compare March 24, 2026 09:20
keyzou and others added 12 commits March 24, 2026 10:28
Move limitSection, sanitizeCommitSubject, and sanitizePrTitle into a
dedicated textGenerationUtils module so they can be reused by multiple
text generation providers.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Replace the single DEFAULT_GIT_TEXT_GENERATION_MODEL constant with a
DEFAULT_GIT_TEXT_GENERATION_MODEL_BY_PROVIDER map keyed by provider kind,
enabling per-provider default models. Update all consumers.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
…nterfaces

Introduce a standalone TextGenerationProvider union type and add an
optional provider field to all text generation input interfaces, allowing
callers to select which backend generates the content.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Add ClaudeTextGeneration layer that spawns `claude -p` with structured
JSON output for commit messages, PR content, and branch names. Introduce
a RoutingTextGeneration layer that dispatches to Codex or Claude based
on the provider field, and wire it into the server DI graph. Thread the
provider selection through GitManager to all text generation call sites.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Add a provider selector (Codex/Claude) to the git settings panel with
dynamic model options per provider. Pass the selected provider through
to the stacked action mutation. Also fix a pre-existing bug where the
model field name was incorrect in the RPC call.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Match the pattern already used by Codex (CODEX_REASONING_EFFORT)
to make the setting visible and easy to change.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
- Extract prompt construction logic into buildCommitMessagePrompt, buildPrContentPrompt, and buildBranchNamePrompt in new textGenerationPrompts.ts
- Replace duplicate normalizeClaudeError and normalizeCodexError with shared normalizeCliError function parameterized by CLI name
- Update Claude and Codex text generation layers to use shared utilities, reducing duplication
- Add comprehensive tests for prompt builders and error normalization
- Consolidate provider and model selection into reusable component
- Replace getAppModelOptions with getCustomModelOptionsByProvider
- Simplifies settings UI and enables reuse across the app
Remove explicit result interfaces with incorrect type annotations
(Schema.Struct.Type<any>) and let TypeScript infer return types.
Split the ternary schema assignment into separate return branches
so TypeScript preserves a proper union instead of widening to any.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Both ClaudeTextGeneration and CodexTextGeneration had identical logic
to convert an Effect Schema into a flat JSON Schema object. Move it
into textGenerationUtils.ts as a single shared helper.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Pass selectedModel (scoped to the active provider) through to
getAppModelOptions so non-built-in models appear in the dropdown.
Restore the per-setting reset button on the git writing model row.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@keyzou
Copy link
Author

keyzou commented Mar 24, 2026

Left a few items from bugbot, should be fine if left as-is but leaving the last call to the maintainers

@keyzou keyzou force-pushed the feat/claude-text-generation branch from cb76bce to e30f4b6 Compare March 24, 2026 09:32
Copy link
Contributor

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

There are 3 total unresolved issues (including 2 from previous reviews).

Fix All in Cursor

Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Pass input.textGenerationProvider to runFeatureBranchStep so the
routing layer respects the user's provider choice instead of always
falling back to Codex.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XL 500-999 changed lines (additions + deletions). vouch:unvouched PR author is not yet trusted in the VOUCHED list.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: Allow Claude to generate commit messages

2 participants