nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 20 Packages Projects Releases Wiki Activity

llama : clarify nemotron-h.cpp comment about RoPE [no ci] (#18997)

Browse Source 
This commit removes the mention of RoPE in the comment for the Q and K
computation as RoPE is not applied.
This commit is contained in:
Daniel Bevenius
2026-01-21 18:31:34 +01:00
committed by GitHub
parent bd544c94a3
commit 9da3dcd753
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
src/models/nemotron-h.cpp
+1 -1
View File
@@ -67,7 +67,7 @@ ggml_tensor * llm_build_nemotron_h::build_attention_layer(ggml_tensor *
const llama_model & model, const llama_model & model,
const int64_t n_embd_head, const int64_t n_embd_head,
const int il) { const int il) {
// compute Q and K and (optionally) RoPE them // compute Q and K
ggml_tensor * Qcur = build_lora_mm(model.layers[il].wq, cur); ggml_tensor * Qcur = build_lora_mm(model.layers[il].wq, cur);
cb(Qcur, "Qcur", il); cb(Qcur, "Qcur", il);
if (model.layers[il].bq) { if (model.layers[il].bq) {