4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Gary LinscottandGitHub	be87b6ed20	perplexity : add support for batch size to --perplexity (#407) ... * Add support to batch size for perplexity * Revert "Fix memory allocation issues and seg faults" This reverts commit 4870e455b3. * update from merge * Remove perplexity from main * updates * Update batch size for efficiency	2023-04-14 00:50:42 +03:00
Gary LinscottandGitHub	40ea807a97	Add details on perplexity to README.md (#395)	2023-03-22 08:53:54 -07:00
Gary LinscottandGitHub	486ae645fd	Compute perplexity over prompt (#270) ... * Compute perplexity over prompt * More accurate perplexity calculation - over all logits in the context window (so 512x more tokens!) * Output all perplexitiies * Add timing/ETA	2023-03-21 18:27:42 +02:00
Gary LinscottandGitHub	a81d0c2a17	Fix n^2 loop in tokenization (#254) ... This causes long prompts to parse very slowly.	2023-03-18 11:17:19 +00:00