nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 32 Packages Projects Releases Wiki Activity
142 Commits 1 Branch 0 Tags
e6c9e0986c79ba1cc8848879b2fcce979f9b4672
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Gary LinscottandGitHub 486ae645fd Compute perplexity over prompt (#270) 
* Compute perplexity over prompt

* More accurate perplexity calculation - over all logits in the context window (so 512x more tokens!)

* Output all perplexitiies

* Add timing/ETA
 2023-03-21 18:27:42 +02:00
Gary LinscottandGitHub a81d0c2a17 Fix n^2 loop in tokenization (#254) 
This causes long prompts to parse very slowly.
 2023-03-18 11:17:19 +00:00