Bartowski and GitHub
732b5fbf5e
convert : avoid calls to tokenizer.added_tokens_decoder ( #12473 )
...
tokenizer.added_tokens_decoder returns a fresh dict every time relatively slowly (~0.04s on average) which results in massive slowdowns when we have a huge number of added tokens
2025-03-20 08:36:37 +02:00
4ddd199f6f
llava : Allow locally downloaded models for QwenVL ( #10833 )
...
* Allow locally downloaded models for QwenVL
* Define model_path
* rm trailing space
---------
Co-authored-by: Xuan Son Nguyen <thichthat@gmail.com >
2024-12-15 21:43:25 +01:00
Bartowski and GitHub
ae4b922614
imatrix : Add imatrix to --no-context-shift ( #10766 )
...
This allows for setting the --no-context-shift value in llama-imatrix which is required for models like DeepSeek
2024-12-10 18:23:50 +01:00
Bartowski and GitHub
c429b33beb
llama : add Smaug 70B support ( #7402 )
2024-05-26 15:28:35 +03:00
Bartowski and GitHub
60325fa56f
Remove .attention from skipped tensors to match more accurately ( #7051 )
2024-05-03 01:49:09 +02:00
