[Feature]: does LLamaSharp support linux-arm64 runtime?

[nipeone]

Background & Description

I found that llamasharp has supported below runtime for a while.but not found linux-arm64, Is there any plan to support it?

linux-musl-x64
linux-x64
osx-arm64
osx-x64
win-x64

API & Usage

No response

How to implement

No response

[martindevans]

There's no support for Linux-arm64 at the moment. Would you be interested in working on a PR to include it?

The first step would be modifying compile.yml to include a linux-arm64 build.

[nipeone]

okay, i'll have a try

[nipeone]

I made a few attempts, but PR is a bit difficult due to my inexperience with github actions. I see that the releases of llama.cpp have a compiled ubuntu-arm64 version, can I copy it directly into the project and use it?

[martindevans]

It needs to fit into our pipeline, but it should act as a good guide. The matrix (line 27) is a set of different build targets. The rest of the pipeline will be run once for each thing in the matrix. So adding an arm64 target should involve adding a new item to the matrix, and working out what build defines are needed for arm64

[nipeone]

I have completed a version and am running actions

[github-actions]

This issue has been automatically marked as stale due to inactivity. If no further activity occurs, it will be closed in 7 days.