nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 23 Packages Projects Releases Wiki Activity
2,305 Commits 1 Branch 0 Tags
e7433867288d2f142cffe596f3751bda5d7ee2c7
Commit Graph
4 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Bach LeandGitHub 5daa5f54fd Link to cublas dynamically on Windows even with LLAMA_STATIC (#4506) 2023-12-17 11:57:33 +01:00
Bach LeandGitHub 7cdd30bf1f cuda : allocate all temporary ggml_tensor_extra_gpu from a fixed-size buffer (#2220) 2023-07-14 22:00:58 +03:00
Bach LeandGitHub 7513b7b0a1 llama : add functions that work directly on model (#2197) 
* Remove vocab reference from context

* Add functions that works directly with model
 2023-07-14 21:55:24 +03:00
Bach LeandGitHub c9c74b4e3f llama : add classifier-free guidance (#2135) 
* Initial implementation

* Remove debug print

* Restore signature of llama_init_from_gpt_params

* Free guidance context

* Make freeing of guidance_ctx conditional

* Make Classifier-Free Guidance a sampling function

* Correct typo. CFG already means context-free grammar.

* Record sampling time in llama_sample_classifier_free_guidance

* Shift all values by the max value before applying logsoftmax

* Fix styling based on review
 2023-07-11 19:18:43 +03:00