nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 20 Packages Projects Releases Wiki Activity
9,897 Commits 1 Branch 0 Tags
nik
Commit Graph
4 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
ShijieGitHubGeorgi Gerganov
 		f4dea7da18 llama : add qwen2moe (#6074) 
* support qwen2moe

* fix-review

* metal : support unary ops for nelements % 4 != 0

* metal : require contiguousness for float4 unary kernels

* metal : require contiguousness for float4 unary kernels (cont)

* fix-review

* names : for brevity "SHARED_EXP" -> "SHEXP"

* llama : reuse build_moe_ffn()

* llama : add model type name

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2024-04-16 18:40:48 +03:00
ShijieandGitHub 3466c6ebcf llama : add more qwen2 models (#5071) 2024-01-22 09:33:19 +02:00
ShijieandGitHub 9b75cb2b3c llama : support upcoming Qwen2 (#5037) 2024-01-19 13:53:13 +02:00
ShijieGitHubGeorgi Gerganov
 		37c746d687 llama : add Qwen support (#4281) 
* enable qwen to llama.cpp

* llama : do not GPU split bias tensors

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-12-01 20:16:31 +02:00