llama_cpp

4,154 Commits 1 Branch 0 Tags

2 Commits

Author	SHA1	Message	Date
CausalLMandGitHub	2e59d61c1b	llama : fix ChatGLM4 wrong shape (#9194 ) This should fix THUDM/glm-4-9b-chat-1m and CausalLM/miniG	2024-08-27 09:58:22 +03:00
CausalLMandGitHub	03562f3a86	llama : support attention bias on LLaMA architecture (#4283 ) * Support attention_bias on LLaMA architecture QKVO bias, should fix InternLM (https://github.com/ggerganov/llama.cpp/issues/3133) and works for LLaMAfied Qwen models (https://github.com/ggerganov/llama.cpp/pull/3743#issuecomment-1825923608). * check existence of qkvo bias while loading llama models Tested on LLaMA2, CUDA and CPU. * Update llama.cpp	2023-12-01 20:17:06 +02:00

Author

SHA1

Message

Date

CausalLMandGitHub

2e59d61c1b

llama : fix ChatGLM4 wrong shape (#9194 )

This should fix THUDM/glm-4-9b-chat-1m and CausalLM/miniG

2024-08-27 09:58:22 +03:00

CausalLMandGitHub

03562f3a86

llama : support attention bias on LLaMA architecture (#4283 )

* Support attention_bias on LLaMA architecture

QKVO bias, should fix InternLM (https://github.com/ggerganov/llama.cpp/issues/3133) and works for LLaMAfied Qwen models (https://github.com/ggerganov/llama.cpp/pull/3743#issuecomment-1825923608).

* check existence of qkvo bias while loading llama models

Tested on LLaMA2, CUDA and CPU.

* Update llama.cpp

2023-12-01 20:17:06 +02:00