docs: Add instructions to install llama.cpp from conda-forge (#22219)
* docs: Add instructions to install `llama.cpp` from conda-forge Signed-off-by: Julien Jerphanion <git@jjerphan.xyz> * Rewording of instructions Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> --------- Signed-off-by: Julien Jerphanion <git@jjerphan.xyz> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
This commit is contained in:
co-authored by
Georgi Gerganov
parent
581e8eca8b
commit
a1eb756c0b
@@ -37,7 +37,7 @@ LLM inference in C/C++
|
|||||||
|
|
||||||
Getting started with llama.cpp is straightforward. Here are several ways to install it on your machine:
|
Getting started with llama.cpp is straightforward. Here are several ways to install it on your machine:
|
||||||
|
|
||||||
- Install `llama.cpp` using [brew, nix or winget](docs/install.md)
|
- Install `llama.cpp` using [brew, nix, winget, or conda-forge](docs/install.md)
|
||||||
- Run with Docker - see our [Docker documentation](docs/docker.md)
|
- Run with Docker - see our [Docker documentation](docs/docker.md)
|
||||||
- Download pre-built binaries from the [releases page](https://github.com/ggml-org/llama.cpp/releases)
|
- Download pre-built binaries from the [releases page](https://github.com/ggml-org/llama.cpp/releases)
|
||||||
- Build from source by cloning this repository - check out [our build guide](docs/build.md)
|
- Build from source by cloning this repository - check out [our build guide](docs/build.md)
|
||||||
|
|||||||
+29
-1
@@ -1,12 +1,40 @@
|
|||||||
# Install pre-built version of llama.cpp
|
# Install pre-built version of llama.cpp
|
||||||
|
|
||||||
| Install via | Windows | Mac | Linux |
|
| Install via | Windows | Mac | Linux |
|
||||||
|-------------|---------|-----|-------|
|
|-------------|---------|------|-------|
|
||||||
|
| conda-forge | ✅ | ✅ | ✅ |
|
||||||
| Winget | ✅ | | |
|
| Winget | ✅ | | |
|
||||||
| Homebrew | | ✅ | ✅ |
|
| Homebrew | | ✅ | ✅ |
|
||||||
| MacPorts | | ✅ | |
|
| MacPorts | | ✅ | |
|
||||||
| Nix | | ✅ | ✅ |
|
| Nix | | ✅ | ✅ |
|
||||||
|
|
||||||
|
## conda-forge (Windows, Mac and Linux)
|
||||||
|
|
||||||
|
conda-forge provides builds for:
|
||||||
|
- CUDA (Windows and Linux)
|
||||||
|
- Vulkan (Windows and Linux)
|
||||||
|
- Apple Metal (macOS)
|
||||||
|
|
||||||
|
```sh
|
||||||
|
conda install -c conda-forge llama-cpp
|
||||||
|
```
|
||||||
|
|
||||||
|
```sh
|
||||||
|
mamba install -c conda-forge llama-cpp
|
||||||
|
```
|
||||||
|
|
||||||
|
```sh
|
||||||
|
# Project-local installation
|
||||||
|
pixi add llama-cpp
|
||||||
|
|
||||||
|
# Global installation
|
||||||
|
pixi global install llama-cpp
|
||||||
|
```
|
||||||
|
|
||||||
|
This distribution is managed on [`conda-forge/llama-cpp-feedstock`](https://github.com/conda-forge/llama.cpp-feedstock/).
|
||||||
|
|
||||||
|
Shall you have any problems, please open an issue on [its issue tracker](https://github.com/conda-forge/llama.cpp-feedstock/issues).
|
||||||
|
|
||||||
## Winget (Windows)
|
## Winget (Windows)
|
||||||
|
|
||||||
```sh
|
```sh
|
||||||
|
|||||||
Reference in New Issue
Block a user