CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-10 10:27:03 +00:00
Code Issues Packages Projects Releases Wiki Activity

[SYCL] Fix the sub group size of Intel (#8106)

Browse Source 
* use warp_size macro for all sycl kernels

* fix mask of permute_sub_group_by_xor

* fix rms_norm with correct warp number

* fix rms_norm_f32/group_norm_f32

* move norm to norm.cpp file

* fix quantize bug

* fix mmvq's batch size
This commit is contained in:
luoyu-intel
2024-07-02 02:16:00 +00:00
committed by GitHub
parent 5fac350b9c
commit d08c20edde
9 changed files with 587 additions and 509 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
ggml/src/ggml-sycl/backend.hpp
View File

@@ -20,5 +20,6 @@
#include "mmq.hpp"
#include "mmvq.hpp"
#include "rope.hpp"
#include "norm.hpp"
#endif // GGML_SYCL_BACKEND_HPP