-
Notifications
You must be signed in to change notification settings - Fork 120
Description
Hello,
The relatively new runpod/pytorch:1.0.1-cu1281-torch280-ubuntu2404 image seems to have various issues not present with other images.
Whenever I ssh (via the basic link, no TCP), I get a bunch of errors like bash: export: 'ssh-ed25519': not a valid identifier that are followed by the public keys of people from my orgnaisation (the connection works though).
Downloading models via VLLM seems impossible as well: I ended up using Huggingface CLI to download the weights manually (something that is normally done automatically via vllm serve).
The image has been tried with multiple GPUs (A40, RTX5090) and presents the same behaviour (not found when switching to eg Pytorch 2.4.0 image). Overall it is possible to work with it but I'd be happy to see those issues addressed. Thanks!