[BUG]: LLamaSharp(0.26.0) don't load the folder "cuda12"

[mayo1983]

Description

Reproduction Steps

     NativeLibraryConfig.All

.WithCuda()
.WithLogCallback((level, message) => Console.Write($"{level}: {message}"));
NativeApi.llama_empty_call();

Environment & Configuration

• Operating system:
• .NET runtime version:
• LLamaSharp version:
• CUDA version (if you are using cuda backend):
• CPU & GPU device:

Known Workarounds

No response

[LucaMaccarini]

Hi @mayo1983,
Is tour project using some .targets file imported in tour .csproj? Because i see that your application Is searching runtimes under runtimes folder.
In this release we fixed a bug involvong runtimes loadig and we changed the runtimes directory in to LLamaSharpRuntimes fixing the loading script.
So if your application manages runtimes loading in some how remove that part of code

[mayo1983]

Hi @LucaMaccarini ,
I don't set any runtimes folder in my code,I just only use nuget import the llamasharp,all the settings are use default.

[LucaMaccarini]

The LLamaSharp.Cuda12 already contains as dependency LLamaSharp.Cuda12.Windows, so you have installed 2 times the same LLamaSharp.Cuda12.Windows package: first time installing LLamaSharp.Cuda12 and second time installing LLamaSharp.Cuda12.Windows.

If you are interessed only in LLamaSharp.Cuda12.Windows remove the LLamaSharp.Cuda12 package, but if you are interested in LLamaSharp.Cuda12.Windows and LLamaSharp.Cuda12.Linux packages use LLamaSharp.Cuda12 and remove LLamaSharp.Cuda12.Windows.

Hope it resolves your issue, let me know.