CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-01 09:01:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
4ad0676927330ccc84c66b8ab7c27ddf18aea43d
llama.cpp/ggml-cuda.h
slaren e04dc51988 ggml-cuda : add rope f16, restore performance with parallel decoding (#3272) 
* ggml-cuda : add rope f16, restore performance

* offload KQ_mask with all models

* fix rope shift

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-09-20 14:00:28 +03:00

1.7 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink