CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-11-12 10:47:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
eaa13a48ff4136f01c1cdb79cacd61b67ec53095
llama.cpp/ggml-cuda.cu
Georgi Gerganov eaa13a48ff falcon : fix CUDA inference by making K and Q contiguous (#2830) 
* falcon : fix CUDA inference by making K and Q contiguous

ggml-ci

* cuda : add assert to guard from non-cont ropes
2023-08-27 16:40:48 +03:00

249 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink