nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 30 Packages Projects Releases Wiki Activity
1,909 Commits 1 Branch 0 Tags
3e945cc1e9c06d2001031360e4e303e9548fb02c
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Alex AzarovGitHubGeorgi Gerganov
 		3a48d558a6 metal : replace loop of dispatch_async with dispatch_apply (#4934) 
* Replace loop of dispatch_async with dispatch_apply

* Update ggml-metal.m

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2024-01-16 15:41:27 +02:00
Alex AzarovGitHubGeorgi Gerganov
 		7c8d3abd1a metal : log recommendedMaxWorkingSetSize on iOS 16+ (#4936) 
* metal: Log `recommendedMaxWorkingSetSize` on iOS 16+

* Only log on iOS and macOS, ignoring tvOS and other platforms

* Check for Xcode version before using recommendedMaxWorkingSetSize

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2024-01-16 15:33:02 +02:00
Alex AzarovandGitHub 5f5fe1bd60 metal : correctly set SIMD support flags on iOS (#4923) 
* Correctly set support_simdgroup_reduction and support_simdgroup_mm on iPhone/iPad

* log a little bit more info on iOS
 2024-01-14 10:44:39 +02:00