llama_cpp

452 Commits 1 Branch 0 Tags

3 Commits

Author	SHA1	Message	Date
xaedesandGitHub	54bb60e268	ggml : fix bug in ggml_compute_forward_sum_f32 (#1162 ) The sum over all rows is now computed instead of just the last row	2023-04-24 23:02:02 +02:00
xaedesandGitHub	0c5692345d	examples : add save_load_state example (#1150 ) * add save_load_state example * use <cstdio> instead of <iostream> and fprintf / printf instead of cout * renamed save-load-state example files replacing underscores by dashes	2023-04-24 19:23:31 +03:00
xaedesandGitHub	b6e7f9b09e	llama : add api for getting/setting the complete state: rng, logits, embedding and kv_cache (#1105 ) * reserve correct size for logits * add functions to get and set the whole llama state: including rng, logits, embedding and kv_cache * remove unused variables * remove trailing whitespace * fix comment	2023-04-22 09:21:32 +03:00

Author

SHA1

Message

Date

xaedesandGitHub

54bb60e268

ggml : fix bug in ggml_compute_forward_sum_f32 (#1162 )

The sum over all rows is now computed instead of just the last row

2023-04-24 23:02:02 +02:00

xaedesandGitHub

0c5692345d

examples : add save_load_state example (#1150 )

* add save_load_state example

* use <cstdio> instead of <iostream> and fprintf / printf instead of cout

* renamed save-load-state example files replacing underscores by dashes

2023-04-24 19:23:31 +03:00

xaedesandGitHub

b6e7f9b09e

llama : add api for getting/setting the complete state: rng, logits, embedding and kv_cache (#1105 )

* reserve correct size for logits

* add functions to get and set the whole llama state:

including rng, logits, embedding and kv_cache

* remove unused variables

* remove trailing whitespace

* fix comment

2023-04-22 09:21:32 +03:00