nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 20 Packages Projects Releases Wiki Activity
6,973 Commits 1 Branch 0 Tags
7c23f3f0d4b9f5d6ea140756eb694b562d5acebb
Commit Graph
22 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
R0CKSTARandGitHub 91a2a56556 musa: update compile flags (#16265) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2025-10-02 16:29:56 +03:00
R0CKSTARandGitHub d9e0e7c819 ci : fix musa docker build (#16306) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2025-09-28 16:38:15 +02:00
R0CKSTARandGitHub a86a580a66 musa: upgrade musa sdk to 4.3.0 (#16240) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-09-26 02:56:38 +02:00
R0CKSTARandGitHub 0f7c69689f musa: fix build warnings (#15611) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-09-26 02:56:10 +02:00
R0CKSTARandGitHub b55f06e1aa vulkan.Dockerfile: install vulkan SDK using tarball (#15282) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-08-23 08:58:57 +02:00
R0CKSTARandGitHub 8ad038c0fd musa: add GGML_UNUSED_VARS (#15446) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-08-21 11:06:05 +08:00
R0CKSTARandGitHub a094f38143 musa: fix build warnings (#15258) 
* musa: fix build warnings

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* fix warning: comparison of integers of different signs: 'const int' and 'unsigned int' [-Wsign-compare]

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-08-20 10:17:37 +08:00
R0CKSTARandGitHub 67f09a3a27 musa: handle __hgt2_mask, available starting from MUSA SDK rc4.3.0 (#15413) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-08-19 12:33:47 +02:00
R0CKSTARandGitHub 25ff6f7659 musa: fix failures in test-backend-ops for mul_mat_id op (#15236) 
* musa: fix failures in test-backend-ops for mul_mat_id op

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Address review comments

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-08-12 10:02:51 +08:00
R0CKSTARandGitHub 3025b621d1 llama-bench: rename DB table name from test to llama_bench (#15003) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-08-02 17:20:40 +08:00
R0CKSTARGitHubJohannes Gäßler
 		484b2091ce compare-commits.sh: support both llama-bench and test-backend-ops (#14392) 
* compare-commits.sh: support both llama-bench and test-backend-ops

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* Speed up the build by specifying -j 12

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Remove build_number from test-backend-ops db

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Apply suggestion from @JohannesGaessler

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* Refine tool selection logic

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Address review comments

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
 2025-08-01 08:47:27 +08:00
R0CKSTARandGitHub 9b8f3c6c77 musa: fix build warnings (unused variable) (#14869) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-07-26 10:36:02 +08:00
R0CKSTARandGitHub 3f4fc97f1d musa: upgrade musa sdk to rc4.2.0 (#14498) 
* musa: apply mublas API changes

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: update musa version to 4.2.0

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: restore MUSA graph settings in CMakeLists.txt

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: disable mudnnMemcpyAsync by default

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: switch back to non-mudnn images

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* minor changes

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: restore rc in docker image tag

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-07-24 20:05:37 +01:00
R0CKSTARandGitHub 48b86c4fdb cuda: remove linking to cublasLt (#14790) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-07-22 07:45:26 +08:00
R0CKSTARandGitHub cbc68be51d cuda: fix build warnings in set-rows.cu (unused variable) (#14687) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-07-15 15:28:53 +08:00
R0CKSTARandGitHub 68155c66f0 musa: fix build warnings (unused variable) (#14561) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-07-08 07:58:30 +08:00
R0CKSTARGitHubslaren
 		b81510a7b7 test-backend-ops: add support for specifying output format (#14368) 
* test-backend-ops: add support for specifying output format

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* Address review comments

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* Add build_commit and build_number in test_result

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* Address review comments

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* refactor

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* Get build commit from ggml_commit()

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* Merge errors into test_operation_info && address review comments

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* Address review comments

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* Address review comments

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* remove visitor nonsense

* remove visitor comment

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

* Address review comments

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>

---------

Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Co-authored-by: slaren <slarengh@gmail.com>
 2025-07-05 12:10:53 +08:00
R0CKSTARGitHubJohannes Gäßler
 		716301d1b0 musa: enable fp16 mma (all) and cublas on qy2 (#13842) 
* musa: enable fp16 mma (all) and cublas on qy2

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Update ggml/src/ggml-cuda/ggml-cuda.cu

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* Address review comments

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Address review comments

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: disable MUL_MAT_ID (q2_k × f32) due to precision issues

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
 2025-06-26 12:11:59 +08:00
R0CKSTARandGitHub fe9d60e74a musa: fix build warning (unused variable) (#14231) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-06-17 17:48:08 +08:00
R0CKSTARandGitHub dc0623fddb webui: fix sidebar being covered by main content (#14082) 
* webui: fix sidebar being covered by main content

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* webui: update index.html.gz

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-06-09 12:01:17 +02:00
R0CKSTARGitHubJohannes Gäßler
 		33983057d0 musa: Upgrade MUSA SDK version to rc4.0.1 and use mudnn::Unary::IDENTITY op to accelerate D2D memory copy (#13647) 
* musa: fix build warning (unused parameter)

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: upgrade MUSA SDK version to rc4.0.1

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: use mudnn::Unary::IDENTITY op to accelerate D2D memory copy

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Update ggml/src/ggml-cuda/cpy.cu

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* musa: remove MUDNN_CHECK_GEN and use CUDA_CHECK_GEN instead in MUDNN_CHECK

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
 2025-05-21 09:58:49 +08:00
R0CKSTARandGitHub e54c35e4fb feat: Support Moore Threads GPU (#8383) 
* Update doc for MUSA

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Add GGML_MUSA in Makefile

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Add GGML_MUSA in CMake

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* CUDA => MUSA

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* MUSA adds support for __vsubss4

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Fix CI build failure

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2024-07-28 01:41:25 +02:00