llama_cpp

4,090 Commits 1 Branch 0 Tags

3 Commits

Author	SHA1	Message	Date
leo-ponyandGitHub	329ed914c9	CANN: adjust backend registry refactor. (#10158 ) remove buffer->iface.get_name that used in cann as it was removed in backend registry refactor PR.	2024-11-04 19:08:22 +08:00
leo-ponyandGitHub	6b8447352d	[CANN] Adapt to dynamically loadable backends mechanism (#9970 ) * [CANN] Adapt to dynamically loadable backends mechanism * Fix the Bug: inference running result is garbled in debug running model for LM models who's type is Q4_0 class * Handle the review comments of this pull request	2024-10-22 16:16:01 +08:00
leo-ponyandGitHub	becfd387f6	[CANN] Fix cann compilation error (#9891 ) Fix cann compilation error after merging llama.cpp supports dynamically loadable backends.	2024-10-16 08:51:46 +08:00

Author

SHA1

Message

Date

leo-ponyandGitHub

329ed914c9

CANN: adjust backend registry refactor. (#10158 )

remove buffer->iface.get_name that used in cann as it was removed in backend registry refactor PR.

2024-11-04 19:08:22 +08:00

leo-ponyandGitHub

6b8447352d

[CANN] Adapt to dynamically loadable backends mechanism (#9970 )

* [CANN] Adapt to dynamically loadable backends mechanism

* Fix the Bug: inference running result is garbled in debug running model for LM models who's type is Q4_0 class

* Handle the review comments of this pull request

2024-10-22 16:16:01 +08:00

leo-ponyandGitHub

becfd387f6

[CANN] Fix cann compilation error (#9891 )

Fix cann compilation error after merging llama.cpp supports dynamically loadable backends.

2024-10-16 08:51:46 +08:00