Skip to content

Support use of models from different vendor using google plugin #4591

@Harsh-Mahajan-Copart

Description

@Harsh-Mahajan-Copart

Feature Type

Would make my life easier

Feature Description

Currently, I am self hosting the agent on google kubernetes engine and was using gemini models as the LLM. There is an ongoing issue with gemini-2.5-flash where the model does not generate any response. That pushed me to search for a different model. Vertex AI provides various foundational models like claude, llama etc. But I cannot use directly with google plugin available.
Hence, I am proposing an enhancement that allows us to use various kinds of models available on google directly using the google plugin.

Workarounds / Alternatives

No response

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions