llama_cpp

9,323 Commits 1 Branch 0 Tags

2 Commits

Author	SHA1	Message	Date
Steward Garcia GitHub Georgi Gerganov	ce18d727a4	clip : enable gpu backend (#4205 ) * clip: enable CUDA backend * add missing kernels * add enough padding for alignment * remove ggml_repeat of clip.cpp * add metal backend * llava : fixes - avoid ggml_repeat - use GGML_USE_ instead of CLIP_USE_ macros - remove unused vars --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2023-12-29 18:52:15 +02:00
Steward GarciaandGitHub	7e4ea5beff	examples : add server example with REST API (#1443 ) * Added httplib support * Added readme for server example * fixed some bugs * Fix the build error on Macbook * changed json11 to nlohmann-json * removed some whitespaces * remove trailing whitespace * added support custom prompts and more functions * some corrections and added as cmake option	2023-05-21 20:51:18 +03:00

Author

SHA1

Message

Date

ce18d727a4

clip : enable gpu backend (#4205 )

* clip: enable CUDA backend

* add missing kernels

* add enough padding for alignment

* remove ggml_repeat of clip.cpp

* add metal backend

* llava : fixes

- avoid ggml_repeat
- use GGML_USE_ instead of CLIP_USE_ macros
- remove unused vars

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2023-12-29 18:52:15 +02:00

Steward GarciaandGitHub

7e4ea5beff

examples : add server example with REST API (#1443 )

* Added httplib support

* Added readme for server example

* fixed some bugs

* Fix the build error on Macbook

* changed json11 to nlohmann-json

* removed some whitespaces

* remove trailing whitespace

* added support custom prompts and more functions

* some corrections and added as cmake option

2023-05-21 20:51:18 +03:00