llama_cpp

2 Commits

Author SHA1 Message Date

Author	SHA1	Message	Date
stduhpfandGitHub	e0324285a5	speculative : threading options (#4959 ) * speculative: expose draft threading * fix usage format * accept -td and -tbd args * speculative: revert default behavior when -td is unspecified * fix trailing whitespace	2024-01-16 13:04:32 +02:00
stduhpf GitHub Georgi Gerganov	da5eaef1f3	speculative : support `--color` (#4343 ) * speculative: add some colors * minor : add braces --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2023-12-06 10:08:17 +02:00

e0324285a5

speculative : threading options (#4959 )

* speculative: expose draft threading

* fix usage format

* accept -td and -tbd args

* speculative: revert default behavior when -td is unspecified

* fix trailing whitespace

2024-01-16 13:04:32 +02:00

da5eaef1f3

speculative : support --color (#4343 )

* speculative: add some colors

* minor : add braces

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2023-12-06 10:08:17 +02:00