Skip to content

Add riscv64 support#1

Merged
ggerganov merged 6 commits intoggml-org:riscv64from
luhenry:main
Apr 14, 2026
Merged

Add riscv64 support#1
ggerganov merged 6 commits intoggml-org:riscv64from
luhenry:main

Conversation

@luhenry
Copy link
Copy Markdown

@luhenry luhenry commented Apr 8, 2026

This should fix our current challenges with longer build times on riscv64 builders.

dependabot bot and others added 4 commits March 26, 2026 11:09
Bumps  and [picomatch](https://github.com/micromatch/picomatch). These dependencies needed to be updated together.

Updates `picomatch` from 4.0.3 to 4.0.4
- [Release notes](https://github.com/micromatch/picomatch/releases)
- [Changelog](https://github.com/micromatch/picomatch/blob/master/CHANGELOG.md)
- [Commits](micromatch/picomatch@4.0.3...4.0.4)

Updates `picomatch` from 2.3.1 to 2.3.2
- [Release notes](https://github.com/micromatch/picomatch/releases)
- [Changelog](https://github.com/micromatch/picomatch/blob/master/CHANGELOG.md)
- [Commits](micromatch/picomatch@4.0.3...4.0.4)

---
updated-dependencies:
- dependency-name: picomatch
  dependency-version: 4.0.4
  dependency-type: indirect
- dependency-name: picomatch
  dependency-version: 2.3.2
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [fast-xml-parser](https://github.com/NaturalIntelligence/fast-xml-parser) from 5.4.1 to 5.5.7.
- [Release notes](https://github.com/NaturalIntelligence/fast-xml-parser/releases)
- [Changelog](https://github.com/NaturalIntelligence/fast-xml-parser/blob/master/CHANGELOG.md)
- [Commits](NaturalIntelligence/fast-xml-parser@v5.4.1...v5.5.7)

---
updated-dependencies:
- dependency-name: fast-xml-parser
  dependency-version: 5.5.7
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [handlebars](https://github.com/handlebars-lang/handlebars.js) from 4.7.8 to 4.7.9.
- [Release notes](https://github.com/handlebars-lang/handlebars.js/releases)
- [Changelog](https://github.com/handlebars-lang/handlebars.js/blob/v4.7.9/release-notes.md)
- [Commits](handlebars-lang/handlebars.js@v4.7.8...v4.7.9)

---
updated-dependencies:
- dependency-name: handlebars
  dependency-version: 4.7.9
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@luhenry
Copy link
Copy Markdown
Author

luhenry commented Apr 8, 2026

cc @CISC @taronaeo

luhenry added a commit to riseproject-dev/llama.cpp that referenced this pull request Apr 8, 2026
@luhenry
Copy link
Copy Markdown
Author

luhenry commented Apr 8, 2026

@luhenry
Copy link
Copy Markdown
Author

luhenry commented Apr 8, 2026

@luhenry
Copy link
Copy Markdown
Author

luhenry commented Apr 9, 2026

This is working and bringing a good speedup:

@luhenry
Copy link
Copy Markdown
Author

luhenry commented Apr 9, 2026

@CISC this works and should be ready to be merged

@CISC
Copy link
Copy Markdown
Member

CISC commented Apr 9, 2026

@CISC this works and should be ready to be merged

Still not sure how to proceed with this. @ggerganov?

@ggerganov
Copy link
Copy Markdown
Member

@CISC What is the concern?

@luhenry
Copy link
Copy Markdown
Author

luhenry commented Apr 9, 2026

To be clear, the binaries downloaded are from https://github.com/mozilla/sccache. Everything is coming from upstream, nothing is coming from https://github.com/riseproject-dev anymore.

@CISC
Copy link
Copy Markdown
Member

CISC commented Apr 9, 2026

@CISC What is the concern?

Do we merge this and create a temporary tag, then later update the CIs again when resyncing this fork? Whichever way we do that there will be a window where the tag is non-functional for riscv64 at least.

@luhenry
Copy link
Copy Markdown
Author

luhenry commented Apr 9, 2026

You can also push the HEAD of this PR into a separate branch in https://github.com/ggml-org/ccache-action, riscv64 for example, and I can reference that specific commit in https://github.com/ggml-org/llama.cpp/pull/21632/changes#diff-bcad35a8ce45815e92a2ba20e60eed1ebd3cc0d68401b75950a2087aa262b840R78. I've submitted the same changes to upstream, so once it's merged upstream it will flow back here as well

@ggerganov ggerganov changed the base branch from main to riscv64 April 11, 2026 06:38
@ggerganov
Copy link
Copy Markdown
Member

You can also push the HEAD of this PR into a separate branch in https://github.com/ggml-org/ccache-action, riscv64 for example, and I can reference that specific commit in https://github.com/ggml-org/llama.cpp/pull/21632/changes#diff-bcad35a8ce45815e92a2ba20e60eed1ebd3cc0d68401b75950a2087aa262b840R78. I've submitted the same changes to upstream, so once it's merged upstream it will flow back here as well

Sounds good. I've changed the base to the new branch riscv64

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants