Skip to content

[libneuronxla] Add support for PJRT_Client_CreateUninitializedBuffer #1302

@steeve

Description

@steeve

Describe the feature

Sadly it's not possible to use PJRT_Client_CreateUninitializedBuffer.
Still doesn't work on libneuronxla-2.2.8201.0+f46ac1ef

Use Case

This is very useful when creating KV caches.

Proposed Solution

Implement PJRT_Client_CreateUninitializedBuffer using nrt_tensor_allocate, should be fairly trivial ?

Other Information

No response

Acknowledgements

  • I may be able to implement this feature request

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions