nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 21 Packages Projects Releases Wiki Activity
9,897 Commits 1 Branch 0 Tags
nik
Commit Graph
21 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
anzz1andGitHub 585d91a156 cmake : add explicit F16C option (x86) (#576) 
Fixes building for x86 processors missing F16C featureset
MSVC not included, as in MSVC F16C is implied with AVX2/AVX512
 2023-04-13 15:48:21 +03:00
anzz1andGitHub 9cbc404ba6 ci : re-enable AVX512 testing (Windows-MSVC) (#584) 
* CI: Re-enable AVX512 testing (Windows-MSVC)

Now with 100% less base64 encoding

* plain __cpuid is enough here
 2023-03-29 23:44:39 +03:00
anzz1andGitHub 83df5639eb Fix GCC warning about binary literal (#595) 
0b10101010 -> 0xAA /* 0b10101010 */
 2023-03-29 13:20:07 +00:00
anzz1andGitHub a5c42c4b13 Fix typo in llama.h (#593) 2023-03-29 13:19:29 +00:00
anzz1andGitHub 5a5f8b1501 Enable Fused-Multiply-Add (FMA) and F16C/CVT16 vector extensions on MSVC (#375) 
* Enable Fused-Multiply-Add (FMA) instructions on MSVC

__FMA__ macro does not exist in MSVC

* Enable F16C/CVT16 vector extensions on MSVC

__F16C__ macro does not exist in MSVC, but is implied with AVX2/AVX512

* MSVC cvt intrinsics

* Add __SSE3__ macro for MSVC too because why not

even though it's not currently used for anything when AVX is defined
 2023-03-28 22:44:29 +03:00
anzz1andGitHub f1217055ea CI: fix subdirectory path globbing (#546) 
- Changes in subdirectories will now be detecter properly
- (Windows-MSVC) AVX512 tests temporarily disabled
 2023-03-28 22:43:25 +03:00
anzz1andGitHub 7f4c5c6651 llama : fix linkage with mingw (#551) 
* Revert 7e53955 (#542)

Still needs to be fixed properly

* Fix linking on mingw32
 2023-03-28 21:23:09 +03:00
anzz1andGitHub 7b8dbcb78b main.cpp fixes, refactoring (#571) 
- main: entering empty line passes back control without new input in interactive/instruct modes
- instruct mode: keep prompt fix
- instruct mode: duplicate instruct prompt fix
- refactor: move common console code from main->common
 2023-03-28 17:09:55 +03:00
anzz1andGitHub 7a87d31f4f [main] fix infinite generation (-n == -1) (#523) 2023-03-26 16:06:10 +03:00
anzz1andGitHub 19726169b3 CI: Run other sanitizer builds even if one fails (#511) 
applies only to sanitizer builds so they wont be cancelled
 2023-03-26 00:13:28 +02:00
anzz1andGitHub 2f7bf7dd7c CMake / CI additions (#497) 
* CMake: Add AVX512 option

* CI: Add AVX/AVX512 builds (Windows)
(AVX512 tests can only be run when the worker happens to support it, building works anyway)

* CMake: Fix sanitizer linkage ( merged #468 )

* CI: Add sanitizer builds (Ubuntu)

* CI: Fix release tagging
(change @zendesk/action-create-release to @anzz1/action-create-release until upstream PR Added commitish as input zendesk/action-create-release#32 is merged)
 2023-03-25 23:38:11 +02:00
anzz1andGitHub 34ab526843 (Windows) Set console to UTF-8 on init (#420) 
Sets console codepage to 65001 (CP_UTF8) on start for both input and output, should fix problems with UTF-8 characters.
 2023-03-25 22:29:22 +02:00
anzz1andGitHub e899bf54b2 bounds checking for input prefix (#492) 2023-03-25 14:42:09 +02:00
anzz1andGitHub fbd4d38c64 feat: '--in-prefix STRING' option (#426) 
Prefix user inputs with a string
 2023-03-25 14:03:19 +02:00
anzz1andGitHub ea10d3ded2 Command line args bounds checking (#424) 
* command line args bounds checking

* unknown and invalid param exit codes 0 -> 1
 2023-03-23 19:54:28 +02:00
anzz1andGitHub 8eea5ae0e5 Delete SHA256SUMS for now (#416) 
Delete this for now to avoid confusion since it contains some wrong checksums from the old tokenizer format
Re-add after #374 is resolved
 2023-03-23 11:26:19 +01:00
anzz1andGitHub e4412b45e3 CI: CMake: Separate build and test steps (#376) 
* CI: Separate Build and Test steps (CMake)

* CI: Make sure build passes before running tests (CMake)

* CI: Standardise step id names
 2023-03-23 04:20:34 +02:00
anzz1 e6c9e0986c Fix bin dir for win ci 2023-03-22 00:01:08 +02:00
anzz1GitHubGeorgi Gerganov
 		c86ba036e6 Enable ANSI colors on Windows 10+ (#311) 
* Enable ANSI colors on Windows 10+

On older versions function will silently fail without any ill effects

* Do not call SetConsoleMode if the mode is already set

* Update main.cpp

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-21 18:14:46 +02:00
anzz1GitHubGeorgi Gerganov
 		975d2cebf9 cmdline option for custom amount of model parts (--n_parts N) (#348) 
* cmdline option for custom amount of model parts (--n_parts N)

* Update main.cpp

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-21 17:42:43 +02:00
anzz1andGitHub b2de7f18df CI Improvements (#230) 
* CI Improvements

Manual build feature, autoreleases for Windows

* better CI naming convention

use branch name in releases and tags
 2023-03-18 09:27:12 +02:00