nikola/llama_cpp
1
0
Fork 0
Code Issues Pull Requests Actions 4 Packages Projects Releases Wiki Activity

hexagon: basic/generic op fusion support and RMS_NORM+MUL fusion (#23835)

Browse Source 
Updating infra to enable op fusion and using RMS_NORM+MUL as the use-case.
This commit is contained in:
Max Krasnyansky
2026-05-28 14:05:54 -07:00
committed by GitHub
parent 751ebd17a5
commit 19e92c33ef
7 changed files with 498 additions and 237 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
scripts/snapdragon/ggml-hexagon-profile.py
View File

@@ -24,7 +24,7 @@ COL_MAP = {
}
op_pattern = re.compile(
r"profile-op\s+(?P<op_name>[A-Z_0-9]+):\s+.*?\s+:\s+(?P<dims>[\d:x\s\->!]+)\s+:\s+(?P<types>[a-z\d_\s\->x]+)\s+:\s+.*?\s+usec\s+(?P<usec>\d+)\s+cycles\s+(?P<cycles>\d+)(?:\s+pmu\s+\[(?P<pmu>[\d,\s]+)\])?"
r"profile-op\s+(?P<op_name>[A-Z_0-9+]+):\s+.*?\s+:\s+(?P<dims>[\d:x\s\->!]+)\s+:\s+(?P<types>[a-z\d_\s\->x]+)\s+:\s+.*?\s+usec\s+(?P<usec>\d+)\s+cycles\s+(?P<cycles>\d+)(?:\s+pmu\s+\[(?P<pmu>[\d,\s]+)\])?"
)
logger = logging.getLogger("ggml-hexagon-profile")