Skip to content

Pytorch 2.8.0 image issues #101

@nFunctor

Description

@nFunctor

Hello,

The relatively new runpod/pytorch:1.0.1-cu1281-torch280-ubuntu2404 image seems to have various issues not present with other images.

Whenever I ssh (via the basic link, no TCP), I get a bunch of errors like bash: export: 'ssh-ed25519': not a valid identifier that are followed by the public keys of people from my orgnaisation (the connection works though).

Downloading models via VLLM seems impossible as well: I ended up using Huggingface CLI to download the weights manually (something that is normally done automatically via vllm serve).

The image has been tried with multiple GPUs (A40, RTX5090) and presents the same behaviour (not found when switching to eg Pytorch 2.4.0 image). Overall it is possible to work with it but I'd be happy to see those issues addressed. Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions