Skip to content

Installation Problems #75

@EranKishon

Description

@EranKishon

I find your work very interesting but can't seem to succeed in installing the required libraries.
In particular, the "NVIDIA Servers step-by-step guide" fails as if there is a consistent version problem between torch, cuda, flash-attn, and xformers:

torch==2.4.0
torchvision==0.19.0

may need to build from source
apex (https://github.com/NVIDIA/apex)

choose the correct wheel packages or build from the source
xformers>=0.0.27
flash-attn>=2.6.3

Are these indeed the correct versions? Am I the only one facing these problems? Any chance of providing a Dockerfile?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions