CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-18 11:46:58 +00:00
Code Issues Packages Projects Releases Wiki Activity

[SYCL] refactor (#6408)

Browse Source 
* seperate lower precision GEMM from the main files

* fix workgroup size hardcode
This commit is contained in:
Meng, Hengyu
2024-06-19 09:11:51 +08:00
committed by GitHub
parent 37bef89433
commit 623494a478
13 changed files with 7600 additions and 6997 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
ggml-sycl/presets.hpp
View File

@@ -18,8 +18,6 @@
#define GGML_SYCL_MAX_DEVICES 48
#define GGML_SYCL_NAME "SYCL"
// FIXME: 1024 from cuda
#define GROUP_SIZE 1024
#define WARP_SIZE 32
#define MATRIX_ROW_PADDING 512 // last row of quant. matrices is a multiple of this to avoid out-of-bounds memory accesses