Skip to content

Conversation

@ashivadi
Copy link

@ashivadi ashivadi commented Nov 27, 2025

Description

This PR provides access to SAP GenAI Hub model provider via strands. SAP GenAI Hub provides access to foundation models (Nova, Claude, Titan) via Bedrock through SAP's AI Core infrastructure.

SAP customers using SAP BTP with GenAI Hub currently use Strands Agents with their SAP-hosted models using DIY approach provided here https://github.com/aws-samples/sample-sap-genai-hub-bedrock/blob/main/util/strands_bedrock_sap_genai_hub.py.

Problem Statement

[FEATURE] Add SAP BTP GenAI Hub model provider support #1255

Documentation PR

strands-agents/docs#345

Type of Change

New feature

Testing

How have you tested the change? Verify that the changes do not break functionality or introduce warnings in consuming repositories: agents-docs, agents-tools, agents-cli

  • [✓] I ran hatch run prepare

Checklist

  • [ ✓] I have read the CONTRIBUTING document
  • [✓ ] I have added any necessary tests that prove my fix is effective or my feature works
  • [✓] I have updated the documentation accordingly
  • [✓ ] I have added an appropriate example to the documentation to outline the feature, or no new docs are needed
  • [ ✓] My changes generate no new warnings
  • [ ✓] Any dependent changes have been merged and published

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

- Add SAPGenAIHubModel class with support for Nova, Claude, and Titan models
- Implement streaming and non-streaming response handling
- Add tool calling and structured output support
- Include comprehensive unit tests (13 tests, 100% pass rate)
- Follow project style guide and conventions

The SAP GenAI Hub provider enables Strands Agents to work with models
hosted on SAP BTP GenAI Hub, providing access to foundation models
through SAP's AI Core infrastructure.

Users need: pip install 'generative-ai-hub-sdk[all]'
@yonib05
Copy link
Member

yonib05 commented Dec 5, 2025

Hey @ashivadi,

Thank you so much for this PR and your contribution! We really appreciate the work you've put into this, and SAP GenAI Hub looks like a fantastic model provider integration.
While we'd love to include every great model provider, we've reached a point where we need to be selective about adding new providers directly to the core SDK to keep it maintainable and focused.

That said, we absolutely want to support your integration! We'd recommend one of these approaches:

  • Option 1: Publish your model provider implementation as a standalone package on PyPI. This way, customers can easily install it and use it with our SDK. Here are some great examples of how this works: Clova Studio and Nvidia NIM.
  • Option 2: Include it as a submodule in the official SAP Gen AI Hub SDK, which would give users direct access through an existing package similar to what they have for LangChain.

Either way, we'd be happy to feature you on our documentation page as a supported model provider, giving you visibility to our community. You can find more details here.

Would either of these approaches work for your use case? We're excited to see SAP GenAI Hub integrated with our ecosystem!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants