CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-14 11:07:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,888 Commits 500 Branches 4,790 Tags
12a9751d467ccafe25dc8db548afea59f513f76b
Commit Graph

3 Commits

Author SHA1 Message Date
Neo Zhang Jianyu
b260213755 [SYCL] refactor soft_max, add soft_max_back (#16472) 
* refactor to support soft_max_ext

* fix error and support soft_max_back

* rm unused functions

* fix format issue

---------

Co-authored-by: Zhang Jianyu <zhang.jianyu@outlook.com>
 2025-10-09 10:25:11 +03:00
Akarshan Biswas
6e84b0ab8e SYCL : SOFTMAX F16 mask support and other fixes (#11261) 
Implemented ggml_sycl_op_soft_max() F16 src1(mask) support for which a pragma deprecation warning was added during #5021.
To do this, had to decouple it from ggml_sycl_op_flatten which always considered src1 to be of fp32 type(many OP functions are dependent on it).

* SYCL: SOFTMAX F16 mask support and other fixes

* test-backend-ops: Add F16 mask test cases
 2025-01-28 09:56:58 +00:00
luoyu-intel
a9554e20b6 [SYCL] Fix WARP_SIZE=16 bug of Intel GPU (#8266) 
* fix group_norm ut

* split softmax

* fix softmax

* add concat support condition

* revert debug code

* move QK_WARP_SIZE to presets.hpp
 2024-07-05 13:06:13 +08:00