nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 19 Packages Projects Releases Wiki Activity
9,897 Commits 1 Branch 0 Tags
nik
Commit Graph
4 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Gary LinscottandGitHub be87b6ed20 perplexity : add support for batch size to --perplexity (#407) 
* Add support to batch size for perplexity

* Revert "Fix memory allocation issues and seg faults"

This reverts commit 4870e455b3.

* update from merge

* Remove perplexity from main

* updates

* Update batch size for efficiency
 2023-04-14 00:50:42 +03:00
Gary LinscottandGitHub 40ea807a97 Add details on perplexity to README.md (#395) 2023-03-22 08:53:54 -07:00
Gary LinscottandGitHub 486ae645fd Compute perplexity over prompt (#270) 
* Compute perplexity over prompt

* More accurate perplexity calculation - over all logits in the context window (so 512x more tokens!)

* Output all perplexitiies

* Add timing/ETA
 2023-03-21 18:27:42 +02:00
Gary LinscottandGitHub a81d0c2a17 Fix n^2 loop in tokenization (#254) 
This causes long prompts to parse very slowly.
 2023-03-18 11:17:19 +00:00